Touching words is not enough: How visual experience influences haptic–auditory associations in the “Bouba–Kiki” effect

@article{Fryer2014TouchingWI,
  title={Touching words is not enough: How visual experience influences haptic–auditory associations in the “Bouba–Kiki” effect},
  author={Louise Fryer and Jonathan Freeman and Linda Pring},
  journal={Cognition},
  year={2014},
  volume={132},
  pages={164-173}
}
Since Köhler's experiments in the 1920s, researchers have demonstrated a correspondence between words and shapes. Dubbed the "Bouba-Kiki" effect, these auditory-visual associations extend across cultures and are thought to be universal. More recently the effect has been shown in other modalities including taste, suggesting the effect is independent of vision. The study presented here tested the "Bouba-Kiki" effect in the auditory-haptic modalities, using 2D cut-outs and 3D models based on K… Expand
Bouba or kiki with and without vision: Shape-audio regularities and mental images.
TLDR
This study investigated the bouba/kiki-effect when using haptic touch instead of vision, including the role of visual imagery, and found that the sensory regularities and mental images concerning bouba and kiki do not have to be based on, or even include visual information. Expand
The feeling of "kiki": Comparing developmental changes in sound-shape correspondence for audio-visual and audio-tactile stimuli.
TLDR
The finding suggests that AT sound- shape correspondence is weak early in development relative to AV sound-shape correspondence, paralleling previous findings on the development of other types of multisensory associations. Expand
Bouba/Kiki in Touch: Associations Between Tactile Perceptual Qualities and Japanese Phonemes
TLDR
This study conducted an explorative study on cross-modal associations of tactile sensations using spontaneous production of Japanese SSWs and semantic ratings to demonstrate the existence of systematic associations between sounds and tactile fundamental perceptual dimensions in a more detailed and comprehensive way than ever done so before. Expand
Differentiated audio-tactile correspondences in sighted and blind individuals.
TLDR
Whether the crossmodal correspondence robustly documented between auditory pitch and visual elevation has analogues in the audio-tactile domain and the origin of the widely discussed association between pitch and vertical elevation are investigated are investigated. Expand
Multimodal Interaction of Contextual and Non-Contextual Sound and Haptics in Virtual Simulations
TLDR
Whether the presence or absence of contextually relevant sound cues influences the performance of a simple haptic drilling task is explored and how this is a necessary step in understanding the role of sound on haptic perception is discussed. Expand
When Sandpaper Is 'Kiki' and Satin Is 'Bouba': an Exploration of the Associations Between Words, Emotional States, and the Tactile Attributes of Everyday Materials.
TLDR
The presence and nature of the associations between tactile sensations, the sound of non-words, and people's emotional states are explored and a number of correspondences between tactile surfaces and adjectives related to visual and auditory attributes are revealed. Expand
Investigating the Effect of Visual Imagery and Learning Shape-Audio Regularities on Bouba and Kiki.
TLDR
The results suggest that the blindfold-group draw upon visual imagery to solve new problems, but not long term; that training in noticing bouba/kiki shape-audio regularities affects the bouba-kiki-effect and the recognition of individual bouba and kiki shapes, but differently in each experimental group. Expand
Haptic sound-symbolism in young Spanish-speaking children
TLDR
Associations between nonwords and the rough-smooth tactile dimension in 3-to-4.5-year-old children were examined to suggest that the articulation of nonwords may facilitate or intensify sound symbolism, and that hedonic biases are manifested in the pointing task. Expand
Pseudo-haptics: leveraging cross-modal perception in virtual environments
TLDR
An overview of the current state of the literature in pseudo-haptics is presented, particularly where the user may not have a haptic device available but where the sensation of haptic feedback is useful in providing information or creating a sense of presence. Expand
Sound symbolism in sighted and blind. The role of vision and orthography in sound-shape correspondences
TLDR
The hypothesis that visual experience is necessary for the emergence of non-arbitrary sound-shape correspondences (SSC) is supported by empirical evidence showing reduced SSC in visually impaired people, and differences between sighted and visually impairment people may be due the indirect influence of orthographic letter shape. Expand
...
1
2
3
...

References

SHOWING 1-10 OF 51 REFERENCES
Reference Frame Preferences in Haptics Differ for the Blind and Sighted in the Horizontal but Not in the Vertical Plane
TLDR
In the absence of a dominant cue, such as gravity in the vertical plane, the blind might emphasise the functional relationship between the objects owing to enhanced experience with haptic exploration of objects. Expand
The effects of interference on recognition of haptic pictures in blindfolded sighted participants: the modality of representation of haptic information.
TLDR
Haptic picture recognition was tested in 36 undergraduate students and suggested that haptic pictures may be represented by coordinating visual and verbal codes. Expand
Altered auditory-tactile interactions in congenitally blind humans: an event-related potential study
TLDR
The present data suggest that developmental visual input is essential for the use of space to integrate input of the non-visual modalities, possibly because of its high spatial resolution. Expand
Association of Haptic Trajectories to Takete and Maluma
TLDR
An experiment has been made, in which participants grasping the stylus of a robotic arm were physically guided along a jagged or rounded trajectory, and then asked to associate either trajectory to the word "takete" or "maluma", indicating the existence of a connectivity between haptic trajectories and words. Expand
The sound of round: evaluating the sound-symbolic role of consonants in the classic Takete-Maluma phenomenon.
  • Alan Nielsen, D. Rendall
  • Psychology, Medicine
  • Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale
  • 2011
TLDR
In both experiments, subjects' image-matching responses showed evidence of tracking the consonant content of words, suggesting the possibility that vowels and consonants both play a role and some methodological factors that might influence their relative effects. Expand
Multisensory visual–tactile object related network in humans: insights gained using a novel crossmodal adaptation approach
TLDR
A crucial first insight into the neuronal basis of visuo-haptic integration of objects in humans is provided and the power of using fMR-A to study multisensory integration using non-invasinve neuroimaging techniques is highlighted. Expand
Early but not late-blindness leads to enhanced auditory perception
TLDR
The performance of blind participants was better than that of sighted participants on a range of auditory perception tasks, even when musical experience was controlled for, providing compelling evidence that superior auditory abilities in blind individuals are not explained by musical experience alone. Expand
Spatial coordinate systems for tactile spatial attention depend on developmental vision: evidence from event‐related potentials in sighted and congenitally blind adult humans
TLDR
It is demonstrated that the default use of an external frame of reference for tactile localization seems to depend on developmental vision, rather than an externally anchored reference system. Expand
Blind Vision: The Neuroscience of Visual Impairment
Can a blind person see? The very idea seems paradoxical. And yet, if we conceive of "seeing" as the ability to generate internal mental representations that may contain visual details, the idea ofExpand
Crossmodal recruitment of primary visual cortex following brief exposure to bimodal audiovisual stimuli
TLDR
The hypothesis that crossmodal cortical recruitment would occur even after a brief exposure to bimodal stimuli without semantic association was tested and the findings indicate that auditory and visual cortices interact with one another to a larger degree than typically assumed. Expand
...
1
2
3
4
5
...