Adverse conditions improve distinguishability of auditory, motor, and perceptuo-motor theories of speech perception: An exploratory Bayesian modelling study

@article{MoulinFrier2012AdverseCI,
  title={Adverse conditions improve distinguishability of auditory, motor, and perceptuo-motor theories of speech perception: An exploratory Bayesian modelling study},
  author={Cl{\'e}ment Moulin-Frier and Rapha{\"e}l Laurent and Pierre Bessi{\`e}re and Jean-Luc Schwartz and Julien Diard},
  journal={Language and Cognitive Processes},
  year={2012},
  volume={27},
  pages={1240 - 1263}
}
In this paper, we put forward a computational framework for the comparison between motor, auditory, and perceptuo-motor theories of speech communication. We first recall the basic arguments of these three sets of theories, either applied to speech perception or to speech production. Then we expose a unifying Bayesian model able to express each theory in a probabilistic way. Focusing on speech perception, we demonstrate that under two hypotheses, regarding communication noise and inter-speaker… Expand
The Complementary Roles of Auditory and Motor Information Evaluated in a Bayesian Perceptuo-Motor Model of Speech Perception
TLDR
COSMO (Communicating Objects using Sensory-Motor Operations), an integrative model that allows principled comparisons of purely motor or purely auditory implementations of a speech perception task and tests the gain of efficiency provided by their Bayesian fusion, is developed. Expand
Computer simulations of coupled idiosyncrasies in speech perception and speech production with COSMO, a perceptuo-motor Bayesian model of speech communication
TLDR
This paper attempts to simulate one study on coupled idiosyncrasies in the perception and production of French oral vowels, within COSMO, a Bayesian computational model of speech communication, and proposes a perceptuo-motor model in which auditory processing would enable optimal processing of learned sounds and motor processing would be helpful in unlearned adverse conditions. Expand
What drives the perceptual change resulting from speech motor adaptation? Evaluation of hypotheses in a Bayesian modeling framework
TLDR
Simulations suggest that some hypotheses concerning the motor and auditory updates that could result from motor learning are compatible with a framework in which motor adaptation updates both the auditory-motor internal model and the auditory characterization of the perturbed phoneme, and where perception involves both auditory and somatosensory pathways. Expand
Reanalyzing neurocognitive data on the role of the motor system in speech perception within COSMO, a Bayesian perceptuo-motor model of speech communication
TLDR
This computational study reinforces functional arguments supporting the role of a motor decoding branch in the speech perception process and proposes the sketch of a neuroanatomical architecture for COSMO, a Bayesian perceptuo‐motor model of speech communication. Expand
COSMO's "motor theory" is not the motor theory of Liberman, Cooper, and Mattingly
TLDR
Findings show that the full sensorimotor model performs better than the motor and auditory subcomponents, and testing fails at least with respect to the motor theory of speech perception, because that theory is not the same as the model's motor subset. Expand
The shadow of a doubt? Evidence for perceptuo-motor linkage during auditory and audiovisual close-shadowing
TLDR
Testing whether the visual modality could speed motor response in a close-shadowing task resulted in results interpreted within a two-stage sensory-motor framework, in which the auditory and visual streams are integrated together and with internally generated motor representations before a final decision may be available. Expand
COSMO SylPhon: A Bayesian Perceptuo-motor Model to Assess Phonological Learning
TLDR
A Bayesian model of speech communication, named "COSMO SylPhon", is proposed, which shows that if agents are equipped with a bootstrap process inspired by the Frame-Content Theory of speech development, they learn to associate consonants to specific articulatory gestures, providing the basis for consonantal articulatory invariance. Expand
Recognizing speech in a novel accent: the motor theory of speech perception reframed
TLDR
A novel computational model of how a listener comes to understand the speech of someone speaking the listener’s native language with a foreign accent, which serves as a reference point for the discussion in Part 3, which proposes a dual-stream neuro-linguistic architecture. Expand
A computational model of perceptuo-motor processing in speech perception: learning to imitate and categorize synthetic CV syllables
This paper presents COSMO, a Bayesian computational model, which is expressive enough to carry out syllable production, perception and imitation tasks using motor, auditory or perceptuo-motorExpand
Echoes on the motor network: how internal motor control structures afford sensory experience
TLDR
Evidence of AMR development from a motor control perspective is reviewed, and it is recommended that activation of these types of internal models outside of action execution may provide an ecological advantage when encountering known stimuli in ambiguous conditions. Expand
...
1
2
3
4
...

References

SHOWING 1-10 OF 50 REFERENCES
The Perception-for-Action-Control Theory (PACT): A perceptuo-motor theory of speech perception
It is an old-standing debate in the field of speech communication to determine whether speech perception involves auditory or multisensory representations and processing, independently on anyExpand
The motor theory of speech perception revised
A motor theory of speech perception, initially proposed to account for results of early experiments with synthetic speech, is now extensively revised to accommodate recent findings, and to relate theExpand
Cortical interactions underlying the production of speech sounds.
  • F. Guenther
  • Psychology, Medicine
  • Journal of communication disorders
  • 2006
TLDR
A model of speech motor control in which a feedforward control system, involving premotor and primary motor cortex and the cerebellum, works in concert with auditory and somatosensory feedback control systems that involve both sensory and motor cortical areas is described. Expand
The Motor Somatotopy of Speech Perception
TLDR
A neurofunctional double dissociation is found in speech sound discrimination, supporting the idea that motor structures provide a specific functional contribution to the perception of speech sounds. Expand
Speech listening specifically modulates the excitability of tongue muscles: a TMS study
TLDR
It is demonstrated that, during speech listening, there is an increase of motor‐evoked potentials recorded from the listeners' tongue muscles when the presented words strongly involve, when pronounced, tongue movements. Expand
A theoretical investigation of reference frames for the planning of speech movements.
TLDR
A 4-part theoretical treatment favoring models whose only invariant targets are regions in auditory perceptual space over models that posit invariant constriction targets is presented, which poses several difficult challenges to proponents of constriction theories. Expand
The Essential Role of Premotor Cortex in Speech Perception
TLDR
The results show that the disruption of human premotor cortex impairs speech perception, thus demonstrating an essential role of premotor cortices in perceptual processes. Expand
Articulatory bias in speech categorization: Evidence from use-induced motor plasticity
TLDR
Using a new technique based on use-induced motor plasticity, it is provided evidence that the motor system can bias perceptual performance in auditory speech recognition and plays a mediating role in phonetic decision/categorization process. Expand
Emergence of articulatory-acoustic systems from deictic interaction games in a “Vocalize to Localize” framework
Since the 70's and Lindblom's proposal to "derive language from non-language", phoneticians have developed a number of "substance-based" theories. The starting point is Lindblom's Dispersion TheoryExpand
Hearing lips and seeing voices: how cortical areas supporting speech production mediate audiovisual speech perception.
TLDR
The results suggest that AV speech elicits in the listener a motor plan for the production of the phoneme that the speaker might have been attempting to produce, and that feedback in the form of efference copy from the motor system ultimately influences the phonetic interpretation. Expand
...
1
2
3
4
5
...