Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study.

@article{Molholm2002MultisensoryAI,
  title={Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study.},
  author={Sophie Molholm and Walter Ritter and Micah M. Murray and Daniel C. Javitt and Charles E. Schroeder and John J. Foxe},
  journal={Brain research. Cognitive brain research},
  year={2002},
  volume={14 1},
  pages={
          115-28
        }
}
View on PubMed
cognitrn.psych.indiana.edu
856 Citations
Highly Influential Citations
80
Background Citations
417
Methods Citations
115
Results Citations
86

Figures and Tables from this paper

856 Citations

Cross-modal processing of auditory–visual stimuli in a no-task paradigm: A topographic event-related potential study

Early Cross-Modal Interactions in Auditory and Visual Cortex Underlie a Sound-Induced Visual Illusion

Evidence is provided that perception of the illusory second flash is based on a very rapid dynamic interplay between auditory and visual cortical areas that is triggered by the second sound.

Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study.

Multisensory object-recognition processes were investigated by examining the combined influence of visual and auditory inputs upon object identification--in this case, pictures and vocalizations of…

Ipsilateral visual and auditory spatial information interaction mechanisms in selective attention conditions: Behavioral and ERP study

The use of event-related potentials to evaluate the neural mechanism of which auditory spatial information affect audiovisual integration in visual attention task indicated that the processing of multi-sensory information was different between left and right brain.

Multisensory processes of auditory–visual stimuli onset asynchrony in human cortex

Modality shift effects mimic multisensory interactions: an event-related potential study

The influence of MSEs on auditory-visual interactions is tested by comparing the results of AV − (A + V) using (a) all stimuli and using (b) only ipsimodal stimuli, and it is formally and empirically demonstrated that (T  + TAV) −-(TA +-TV) is robust against possible biases due to the MSE.

Early modulation of visual cortex by sound: an MEG study

Intracranial Cortical Responses during Visual–Tactile Integration in Humans

Results tend to support earlier concepts of multisensory integration as relatively late and centered in tertiary multimodal association cortices, and suggest two neurophysiologically distinct and temporally separated integration mechanisms in TPOJ.

Visual modulation of neurons in auditory cortex.

It is demonstrated that visual stimuli can modulate the firing of neurons in auditory cortex in a manner that depends on stimulus efficacy and timing, and these neurons meet the criteria for sensory integration and provide the auditory modality with multisensory contextual information about co-occurring environmental events.

Audiovisual integration elicited by stimuli peripherally in divided attention task: An event-related potential study

These interaction effects occurred slightly later than those reported in previously published AV interaction studies in which AV stimuli were presented centrally, and Reaction times to the stimuli when presented simultaneously were significantly faster than when they were presented alone.
...

References

SHOWING 1-10 OF 128 REFERENCES

Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study

The results indicate that multisensory integration is mediated by flexible, highly adaptive physiological processes that can take place very early in the sensory processing chain and operate in both sensory-specific and nonspecific cortical structures in different ways.

Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping.

Visuo-spatial neural response interactions in early cortical processing during a simple reaction time task: a high-density electrical mapping study

An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings.

Detection of Audio-Visual Integration Sites in Humans by Application of Electrophysiological Criteria to the BOLD Effect

The efficacy of using an analytic approach informed by electrophysiology to identify multisensory integration sites in humans is demonstrated and the particular network of brain areas implicated in these crossmodal integrative processes are suggested to be dependent on the nature of the correspondence between the different sensory inputs.

Involuntary Listening Aids Seeing: Evidence From Human Electrophysiology

It is found that orienting spatial attention to an irrelevant sound modulates the ERP to a subsequent visual target over modality-specific, extrastriate visual cortex, but only after the initial stages of sensory processing are completed.

Behavioral Indices of Multisensory Integration: Orientation to Visual Cues is Affected by Auditory Stimuli

The present experiments illustrate that the rules governing multisensory integration at the level of the single cell also predict responses to these stimuli in the intact behaving organism.

Topographic analysis of auditory event-related potentials.

Auditory-visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey

Response amplification in sensory-specific cortices during crossmodal binding.

FMRI data suggest that the perceptual improvements effected by synthesizing matched multisensory inputs are realised by reciprocal amplification of the signal intensity in participating unimodal cortices.
...