Touching words is not enough: How visual experience influences haptic–auditory associations in the “Bouba–Kiki” effect

@article{Fryer2014TouchingWI,
  title={Touching words is not enough: How visual experience influences haptic–auditory associations in the “Bouba–Kiki” effect},
  author={Louise Fryer and Jonathan Freeman and Linda Pring},
  journal={Cognition},
  year={2014},
  volume={132},
  pages={164-173}
}

Figures and Tables from this paper

Bouba or kiki with and without vision: Shape-audio regularities and mental images.

Bouba/Kiki in Touch: Associations Between Tactile Perceptual Qualities and Japanese Phonemes

This study conducted an explorative study on cross-modal associations of tactile sensations using spontaneous production of Japanese SSWs and semantic ratings to demonstrate the existence of systematic associations between sounds and tactile fundamental perceptual dimensions in a more detailed and comprehensive way than ever done so before.

Differentiated audio-tactile correspondences in sighted and blind individuals.

Whether the crossmodal correspondence robustly documented between auditory pitch and visual elevation has analogues in the audio-tactile domain and the origin of the widely discussed association between pitch and vertical elevation are investigated are investigated.

Multimodal Interaction of Contextual and Non-Contextual Sound and Haptics in Virtual Simulations

Whether the presence or absence of contextually relevant sound cues influences the performance of a simple haptic drilling task is explored and how this is a necessary step in understanding the role of sound on haptic perception is discussed.

When Sandpaper Is 'Kiki' and Satin Is 'Bouba': an Exploration of the Associations Between Words, Emotional States, and the Tactile Attributes of Everyday Materials.

The presence and nature of the associations between tactile sensations, the sound of non-words, and people's emotional states are explored and a number of correspondences between tactile surfaces and adjectives related to visual and auditory attributes are revealed.

Investigating the Effect of Visual Imagery and Learning Shape-Audio Regularities on Bouba and Kiki.

The results suggest that the blindfold-group draw upon visual imagery to solve new problems, but not long term; that training in noticing bouba/kiki shape-audio regularities affects the bouba-kiki-effect and the recognition of individual bouba and kiki shapes, but differently in each experimental group.

Haptic sound-symbolism in young Spanish-speaking children

Associations between nonwords and the rough-smooth tactile dimension in 3-to-4.5-year-old children were examined to suggest that the articulation of nonwords may facilitate or intensify sound symbolism, and that hedonic biases are manifested in the pointing task.

Pseudo-haptics: leveraging cross-modal perception in virtual environments

An overview of the current state of the literature in pseudo-haptics is presented, particularly where the user may not have a haptic device available but where the sensation of haptic feedback is useful in providing information or creating a sense of presence.

References

SHOWING 1-10 OF 49 REFERENCES

Reference Frame Preferences in Haptics Differ for the Blind and Sighted in the Horizontal but Not in the Vertical Plane

In the absence of a dominant cue, such as gravity in the vertical plane, the blind might emphasise the functional relationship between the objects owing to enhanced experience with haptic exploration of objects.

The effects of interference on recognition of haptic pictures in blindfolded sighted participants: the modality of representation of haptic information.

Haptic picture recognition was tested in 36 undergraduate students and suggested that haptic pictures may be represented by coordinating visual and verbal codes.

Altered auditory-tactile interactions in congenitally blind humans: an event-related potential study

The present data suggest that developmental visual input is essential for the use of space to integrate input of the non-visual modalities, possibly because of its high spatial resolution.

Association of Haptic Trajectories to Takete and Maluma

An experiment has been made, in which participants grasping the stylus of a robotic arm were physically guided along a jagged or rounded trajectory, and then asked to associate either trajectory to the word "takete" or "maluma", indicating the existence of a connectivity between haptic trajectories and words.

The sound of round: evaluating the sound-symbolic role of consonants in the classic Takete-Maluma phenomenon.

  • Alan NielsenD. Rendall
  • Psychology
    Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale
  • 2011
In both experiments, subjects' image-matching responses showed evidence of tracking the consonant content of words, suggesting the possibility that vowels and consonants both play a role and some methodological factors that might influence their relative effects.

Early but not late-blindness leads to enhanced auditory perception

Blind Vision: The Neuroscience of Visual Impairment

With Blind Vision, Cattaneo and Vecchi take on the "tyranny of the visual," pointing to the importance of the other senses in cognition.

Crossmodal recruitment of primary visual cortex following brief exposure to bimodal audiovisual stimuli

A Putative Model of Multisensory Object Representation

A putative model is proposed in which LOtv, a subregion of LOC, contains a modality-independent representation of geometric shape that can be accessed either bottom-up from direct sensory inputs or top-down from frontoparietal regions, and it is suggested that such access is modulated by object familiarity.

Cross-modal plasticity for the spatial processing of sounds in visually deprived subjects

Recent results regarding the spatial processing of sounds in blind subjects are described to suggest that blind individuals may demonstrate exceptional abilities in auditory spatial processing and that such enhanced performances may be intrinsically linked to the recruitment of occipital areas deprived of their normal visual inputs.