Hearing lips and seeing voices

  title={Hearing lips and seeing voices},
  author={Harry McGurk and John MacDonald},
MOST verbal communication occurs in contexts where the listener can see the speaker as well as hear him. However, speech perception is normally regarded as a purely auditory process. The study reported here demonstrates a previously unrecognised influence of vision upon speech perception. It stems from an observation that, on being shown a film of a young woman's talking head, in which repeated utterances of the syllable [ba] had been dubbed on to lip movements for [ga], normal adults reported… 
Speech Misperception: Speaking and Seeing Interfere Differently with Hearing
Results indicate that the articulatory-induced distortion of speech perception occurs in an articulator-specific manner while visually induced distortion does not, which suggests that speech motor processing directly contributes to the authors' ability to hear speech.
Reading Speech from Still and Moving Faces: The Neural Substrates of Visible Speech
Speech is perceived both by ear and by eye. Unlike heard speech, some seen speech gestures can be captured in stilled image sequences. Previous studies have shown that in hearing people, natural
The development of gaze to a speaking face.
Results indicate an increase in gaze on the face, and specifically, to the mouth of a speaker between the ages of 5 and 10 for all conditions, which may help account for previous findings in the literature showing that visual influence on heard speech increases with development.
Visual speech acts differently than lexical context in supporting speech perception.
  • A. Samuel, J. Lieblich
  • Psychology
    Journal of experimental psychology. Human perception and performance
  • 2014
It is demonstrated here that this dissociation is robust, leading to the conclusion that visual and lexical contexts operate differently, and it is suggested that the dissociation reflects the dual nature of speech as both a perceptual object and a linguistic object.
Auditory-visual integration for speech by children with and without specific language impairment.
The results demonstrate that the difficulties with speech perception by SLI children extend beyond the auditory-only modality to include auditory-visual processing as well.
Phonetic recalibration in audiovisual speech
In the literature on cross-modal perception, there are two important findings that most researchers in this area will know about, although only few have ever made a connection between the two. The
Seeing and hearing others and oneself talk.
Research report Seeing and hearing others and oneself talk
We studied the modification of auditory perception in three different conditions in twenty subjects. Observing other person’s discordant articulatory gestures deteriorated identification of acoustic
Hearing Faces: How the Infant Brain Matches the Face It Sees with the Speech It Hears
It is determined that auditory–visual integration occurs during the early stages of perception as in adults, and brain source modeling revealed that phoneme and gender computations were lateralized toward the left and toward the right hemisphere, respectively, suggesting that each hemisphere possesses an early processing bias.


Auditory and visual contributions to the perception of consonants.
Perceptual confusions of 16 consonant-vowel (CV) syllables were studied with normal-hearing adults under conditions of auditory-visual presentation at various signal-to-noise (S/N) ratios, as well ...