The role of visual experience in the emergence of cross-modal correspondences

@article{HamiltonFletcher2018TheRO,
  title={The role of visual experience in the emergence of cross-modal correspondences},
  author={Giles Hamilton-Fletcher and Katarzyna Pisanski and David Reby and Michał Mikołaj Stefańczyk and Jamie Ward and Agnieszka Sorokowska},
  journal={Cognition},
  year={2018},
  volume={175},
  pages={114-121}
}

Temperature-Based Crossmodal Correspondences: Causes and Consequences.

  • C. Spence
  • Engineering
    Multisensory research
  • 2020
Gaining a better understanding of temperature-based crossmodal correspondences may one day help in the design of more intuitive sensory-substitution devices, and support the delivery of immersive virtual and augmented reality experiences.

Exploring Group Differences in the Crossmodal Correspondences.

There has been a rapid growth of interest amongst researchers in the cross-modal correspondences in recent years. In part, this has resulted from the emerging realization of the important role that

Crossmodal Associations with Olfactory, Auditory, and Tactile Stimuli in Children and Adults

People associate information with different senses but the mechanism by which this happens is unclear. Such associations are thought to arise from innate structural associations in the brain,

Global shape perception contributes to crossmodal correspondences.

The Bouba/Kiki effect was susceptible to the factors modulating the perceptual grouping process going from segments to the global contour, suggesting that the Bouba / Kiki effect may occur at the global level of shape perception.

Heaviness-brightness correspondence and stimulus-response compatibility

Heaviness, alongside size, appears to contribute to cross-sensory correspondences in its own right and in a manner confirming the far-reaching influence of correspondences, extending here to the fluency with which people communicate simple ideas by manipulating a hand-held object.

A Protracted Sensitive Period Regulates the Development of Cross-Modal Sound–Shape Associations in Humans

Evidence is provided for a protracted sensitive period during which aberrant vision prevents SSA acquisition and the finding of a systematic SSA in the LB group demonstrates that representations acquired during the sensitive period are resilient to loss despite dramatically changed experience.

References

SHOWING 1-10 OF 54 REFERENCES

Audio-Visual, Visuo-Tactile and Audio-Tactile Correspondences in Preschoolers.

The results suggest that pitch-height correspondences for audio-visual and audio-tactile combinations may still be weak in preschool children, and speculate that this could be due to immature linguistic and auditory cues that are still developing at age five.

Summation of visual attributes in auditory–visual crossmodal correspondences

This work investigated how the visual dimensions of luminance, saturation, size, and vertical position can influence decisions when matching particular visual stimuli with high-pitched or low-pitches auditory stimuli.

Preverbal Infants’ Sensitivity to Synaesthetic Cross-Modality Correspondences

3- to 4-month-old preverbal infants’ sensitivity to the correspondences linking auditory pitch to visuospatial height and visual sharpness is assessed, giving the strongest indication to date that synaesthetic cross-modality correspondences are an unlearned aspect of perception.

Crossmodal correspondences: A tutorial review

  • C. Spence
  • Psychology
    Attention, perception & psychophysics
  • 2011
The literature reviewed here supports the view thatCrossmodal correspondences need to be considered alongside semantic and spatiotemporal congruency, among the key constraints that help the authors' brains solve the crossmodal binding problem.

Newborns are sensitive to the correspondence between auditory pitch and visuospatial elevation

Newborns' looking behavior was sensitive to this congruence, providing the strongest indication to date that cross-sensory correspondences can be in place at birth.

Natural cross-modal mappings between visual and auditory features.

In a series of speeded classification tasks, spontaneous mappings between the auditory feature of pitch and the visual features of vertical location, size, and spatial frequency are found but not contrast.

Differentiated audio-tactile correspondences in sighted and blind individuals.

Whether the crossmodal correspondence robustly documented between auditory pitch and visual elevation has analogues in the audio-tactile domain and the origin of the widely discussed association between pitch and vertical elevation are investigated are investigated.

Visuoauditory mappings between high luminance and high pitch are shared by chimpanzees (Pan troglodytes) and humans

An inherent tendency to pair high pitch with high luminance hence evolved before the human lineage split from that of chimpanzees, and constitutes a basic feature of the primate sensory system.

Crossmodal Correspondences: Standing Issues and Experimental Guidelines.

Questions about their definition, origins, their plasticity, and their underlying computational mechanisms are reviewed in the light of current research on sensory cue integration, where crossmodal correspondences can be conceptualized in terms of natural mappings across different sensory cues that are present in the environment and learnt by the sensory systems.

Do small white balls squeak? Pitch-object correspondences in young children

Children’s matching of pitch and size cannot be attributed to intensity matching or to learning, and these data support the hypothesis that some cross-modal correspondences are remnants of the neural mechanisms underlying neonatal perception.
...