Communication Goes Multimodal

  title={Communication Goes Multimodal},
  author={Sarah R. Partan and Peter R. Marler},
  pages={1272 - 1273}
Communication depends on the simultaneous receipt of multiple sensory stimuli. The Perspective by Partan and Marler in this week9s issue postulates a new classification system for multimodal sensory signals. Combinations of sensory signals are classified according to the behavioral responses they elicit. 

Issues in the Classification of Multimodal Communication Signals

This work provides an overview of multimodal communication and its costs and benefits, place examples of signals and displays from an array of taxa, sensory systems, and functions into the authors' signal classification system, and considers issues surrounding the categorization of multi-modal signals.

The integration of emotional and symbolic components in multimodal communication

  • M. Mehu
  • Psychology
    Front. Psychol.
  • 2015
It is argued that different components of multimodal signals play different roles in the processes of information transfer and social influence, and that emotion should be considered a property of communicative signals, rather than an entity that is transferred as content by non-verbal signals.

Use and Function of Multi-Articulator Versus Multi-Sensory Acts in the Close-Range Communication of Orang-Utans

It is suggested that communication through multiple sensory channels primarily facilitates effectiveness, whereas a flexible combination of articulators is relevant when social tolerance and interaction outcomes are less predictable.

Social Neuroscience and the Study of Animal Communication

Research into both the mechanistic and evolutionary basis for animal communication systems is likely to benefit from adopting the interdisciplinary perspective of social neuroscience. Here I

Multicomponent and multisensory communicative acts in orang-utans may serve different functions

From early infancy, human face-to-face communication is multimodal, comprising a plethora of interlinked communicative and sensory modalities. Although there is also growing evidence for this in

Multicomponent and multisensory communicative acts in orang-utans may serve different functions

It is argued that multisensory acts primarily facilitate effectiveness, whereas multicomponent acts become relevant when interaction outcomes are less predictable, which underscores the importance of distinguishing between production and perception in studies of communication.

Multilevel rhythms in multimodal communication

An integrative overview of converging findings that show how multimodal processes occurring at neural, bodily, as well as social interactional levels each contribute uniquely to the complex rhythms that characterize communication in human and non-human animals are addressed.



Multimodal integration for the representation of space in the posterior parietal cortex.

  • R. Andersen
  • Biology, Psychology
    Philosophical transactions of the Royal Society of London. Series B, Biological sciences
  • 1997
Experiments from the author's laboratory indicate that visual, somatosensory, auditory and vestibular signals are combined in areas LIP and 7a of the posterior parietal cortex, which appears to be important for specifying the locations of targets for actions such as eye movements or reaching.

Multiple Displays in Animal Communication:`Backup Signals' and `Multiple Messages'

A new game-theoretical model of signalling is described, in which signallers may use more than one display to advertise their qualities, and multiple signals are shown to be stable, even when multiple receiver preferences entail significant costs.

The function of concurrent signals: visual and chemical communication in snapping shrimp

The relative costs and benefits associated with aggressive and pair-forming interactions differ for males and females, and these differences are likely to contribute to the differences in assessment observed here.

Experience-dependent plasticity in the inferior colliculus: a site for visual calibration of the neural representation of auditory space in the barn owl

  • M. BrainardE. Knudsen
  • Biology
    The Journal of neuroscience : the official journal of the Society for Neuroscience
  • 1993
The results indicate that the visual instruction of auditory spatial tuning of neurons in the optic tectum reflects plasticity at the level of the ICx, the site where the auditory map of space is first synthesized.

Vibratory Communication Through Living Plants by a Tropical Wandering Spider

Female Cupiennius salei pheromone on banana and Agave plants elicits patterned oscillations by the male, which guides the male across the plant to her location.

Vocal-Postural Co-Ordination of a Sexually Dimorphic Display in a Monomorphic Species: the Barbary Dove

It is suggested that in the bowing display the gender and the identity are signalled respectively by the bow pattern and the bow-call, and the integration of the two signals generates a third signal, the integrated bow display rate.

Hidden colour aversions in domestic chicks triggered by pyrazine odours of insect warning displays

This study demonstrates, in prey choice experiments with birds, that pyrazine interacts with red and yellow to induce strong aversions to these aposematic colours that are not shown in the absence of the odour.

The Development of Social Interaction, Play, and Metacommunication in Mammals: An Ethological Perspective

  • M. Bekoff
  • Psychology
    The Quarterly Review of Biology
  • 1972
In this review, general concepts of behavioral development in mammals are discussed and analyzed, and the many variables that are involved are considered.

The Cognitive Neurosciences

The fifth edition of a work that defines the field of cognitive neuroscience, with entirely new material that reflects recent advances in the field. Each edition of this classic reference has proved

The Expression of the Emotions in Man and Animals

Acknowledgments List of Illustrations Figures Plates Preface to the Anniversary Edition by Paul Ekman Preface to the Third Edition by Paul Ekman Preface to the Second Edition by Francis Darwin