Hearing lips and seeing voices
@article{McGurk1976HearingLA, title={Hearing lips and seeing voices}, author={Harry McGurk and John MacDonald}, journal={Nature}, year={1976}, volume={264}, pages={746-748} }
MOST verbal communication occurs in contexts where the listener can see the speaker as well as hear him. However, speech perception is normally regarded as a purely auditory process. The study reported here demonstrates a previously unrecognised influence of vision upon speech perception. It stems from an observation that, on being shown a film of a young woman's talking head, in which repeated utterances of the syllable [ba] had been dubbed on to lip movements for [ga], normal adults reported…
5,499 Citations
Speech Misperception: Speaking and Seeing Interfere Differently with Hearing
- PhysicsPloS one
- 2013
Results indicate that the articulatory-induced distortion of speech perception occurs in an articulator-specific manner while visually induced distortion does not, which suggests that speech motor processing directly contributes to the authors' ability to hear speech.
Reading Speech from Still and Moving Faces: The Neural Substrates of Visible Speech
- Biology, PsychologyJournal of Cognitive Neuroscience
- 2003
Speech is perceived both by ear and by eye. Unlike heard speech, some seen speech gestures can be captured in stilled image sequences. Previous studies have shown that in hearing people, natural…
The development of gaze to a speaking face.
- PsychologyThe Journal of the Acoustical Society of America
- 2017
Results indicate an increase in gaze on the face, and specifically, to the mouth of a speaker between the ages of 5 and 10 for all conditions, which may help account for previous findings in the literature showing that visual influence on heard speech increases with development.
Visual speech acts differently than lexical context in supporting speech perception.
- PsychologyJournal of experimental psychology. Human perception and performance
- 2014
It is demonstrated here that this dissociation is robust, leading to the conclusion that visual and lexical contexts operate differently, and it is suggested that the dissociation reflects the dual nature of speech as both a perceptual object and a linguistic object.
Auditory-visual integration for speech by children with and without specific language impairment.
- Psychology, PhysicsJournal of speech, language, and hearing research : JSLHR
- 2007
The results demonstrate that the difficulties with speech perception by SLI children extend beyond the auditory-only modality to include auditory-visual processing as well.
Phonetic recalibration in audiovisual speech
- Psychology
- 2012
In the literature on cross-modal perception, there are two important findings that most researchers in this area will know about, although only few have ever made a connection between the two. The…
Seeing and hearing others and oneself talk.
- Psychology, PhysicsBrain research. Cognitive brain research
- 2005
Research report Seeing and hearing others and oneself talk
- Psychology, Physics
- 2005
We studied the modification of auditory perception in three different conditions in twenty subjects. Observing other person’s discordant articulatory gestures deteriorated identification of acoustic…
Hearing Faces: How the Infant Brain Matches the Face It Sees with the Speech It Hears
- PsychologyJournal of Cognitive Neuroscience
- 2008
It is determined that auditory–visual integration occurs during the early stages of perception as in adults, and brain source modeling revealed that phoneme and gender computations were lateralized toward the left and toward the right hemisphere, respectively, suggesting that each hemisphere possesses an early processing bias.
References
SHOWING 1-2 OF 2 REFERENCES
Auditory and visual contributions to the perception of consonants.
- PhysicsJournal of speech and hearing research
- 1974
Perceptual confusions of 16 consonant-vowel (CV) syllables were studied with normal-hearing adults under conditions of auditory-visual presentation at various signal-to-noise (S/N) ratios, as well ...
The role of selected stimulus-variables in the perception of the unvoiced stop consonants.
- Psychology, MedicineThe American journal of psychology
- 1952