Predicting visual stimuli on the basis of activity in auditory cortices

@article{Meyer2010PredictingVS,
  title={Predicting visual stimuli on the basis of activity in auditory cortices},
  author={Kaspar Meyer and Jonas T. Kaplan and Ryan Essex and Cecelia Webber and Hanna Damasio and Antonio R. Damasio},
  journal={Nature Neuroscience},
  year={2010},
  volume={13},
  pages={667-668}
}
Using multivariate pattern analysis of functional magnetic resonance imaging data, we found that the subjective experience of sound, in the absence of auditory stimulation, was associated with content-specific activity in early auditory cortices in humans. As subjects viewed sound-implying, but silent, visual stimuli, activity in auditory cortex differentiated among sounds related to various animals, musical instruments and objects. These results support the idea that early sensory cortex… 
Spatial pattern of BOLD fMRI activation reveals cross-modal information in auditory cortex.
Recent findings suggest that neural representations in early auditory cortex reflect not only the physical properties of a stimulus, but also high-level, top-down, and even cross-modal information.
Cross-Modal Multivariate Pattern Analysis
TLDR
This work presents an extension of the classical MVPA paradigm, according to which perceptual stimuli are not predicted within, but across sensory systems, and addresses the question of whether stimuli that evoke memory associations in modalities other than the one through which they are presented induce content-specific activity patterns in the sensory cortices of those other modalities.
Flexible Information Coding in Human Auditory Cortex during Perception, Imagery, and STM of Complex Sounds
TLDR
The results of the current study suggest that the type of information encoded in auditory cortex is highly flexible, and highlights the necessity to move beyond traditional “brain mapping” inference in human neuroimaging.
Mapping the contents of consciousness during musical imagery
TLDR
Results indicate that the specific contents of conscious experience are encoded similarly during imagery and perception in the dynamic activity of auditory cortices, and rhythmic motion can enhance the reinstatement of neural patterns associated with the experience of complex sounds.
Auditory modulation of visual stimulus encoding in human retinotopic cortex
Decoding Sound and Imagery Content in Early Visual Cortex
Decoding Visual Location From Neural Patterns in the Auditory Cortex of the Congenitally Deaf
TLDR
It is found that the location of a visual stimulus can be successfully decoded from the patterns of neural activity in auditory cortex of congenitally deaf but not hearing individuals and shows that the representations stored within neuroplastically changed auditory cortex can align with dimensions that are typically represented in visual cortex.
Report Decoding Sound and Imagery Content in Early Visual Cortex
TLDR
It is suggested that early visual cortex receives nonretinal input from other brain areas when it is generated by auditory perception and/or imagery, and this input carries common abstract information.
Decoding the sound of hand-object interactions in primary somatosensory cortex
TLDR
These findings indicate that hearing sounds depicting familiar hand-object interactions elicit different patterns of activity in SI, despite the complete absence of tactile stimulation, and cross-modal connections from audition to SI transmit content-specific information about sounds depictingamiliar hand- object interactions.
Mapping Specific Mental Content during Musical Imagery.
TLDR
Results indicate that the specific contents of conscious experience are encoded similarly during imagery and perception in the dynamic activity of auditory cortices, and rhythmic motion can enhance the reinstatement of neural patterns associated with the experience of complex sounds, in keeping with models of motor to sensory influences in auditory processing.
...
...

References

SHOWING 1-10 OF 25 REFERENCES
Musical imagery: Sound of silence activates auditory cortex
TLDR
Functional magnetic resonance imaging is used to identify and characterize the neural substrates that support unprompted auditory imagery and finds that auditory and visual imagery seem to obey similar basic neural principles.
Activation of auditory cortex during silent lipreading.
TLDR
Three experiments suggest that these auditory cortical areas are not engaged when an individual is viewing nonlinguistic facial movements but appear to be activated by silent meaningless speechlike movements (pseudospeech), which supports psycholinguistic evidence that seen speech influences the perception of heard speech at a prelexical stage.
Stimulus-Specific Delay Activity in Human Primary Visual Cortex
TLDR
Using functional magnetic resonance imaging, it is observed that key sensory regions such as primary visual cortex (V1) showed little evidence of sustained increases in mean activation during a WM delay period, though such amplitude increases have typically been used to determine whether a region is involved in on-line maintenance.
Optical Imaging of a Tactile Illusion in Area 3b of the Primary Somatosensory Cortex
TLDR
It is shown with optical imaging in area 3b of the primary somatosensory cortex (SI) that simultaneous stimulation of two fingertips produces a single focal cortical activation between the single fingertip activation regions.
Topographical representations of mental images in primary visual cortex
TLDR
Findings resolve a debate in the literature about whether imagery activates early visual cortex and indicate that visual mental imagery involves 'depictive' representations, not solely language-like descriptions12–14.
...
...