Cognition and Physio-acoustic Correlates - Audio and Audio-visual Effects of a Short English Emotional Statement: On JL2, FL2 and EL1

@inproceedings{IseiJaakkola2006CognitionAP,
  title={Cognition and Physio-acoustic Correlates - Audio and Audio-visual Effects of a Short English Emotional Statement: On JL2, FL2 and EL1},
  author={Toshiko Isei-Jaakkola},
  booktitle={FinTAL},
  year={2006}
}
This paper concerns the correlation between cognition test results from audio and audio-visual effects on nine English emotional words and the physio-acoustic distances. Two parameters were selected; F0 and intensity. The two types of distance were calculated: the average and pattern-distance for each emotion. 2 Japanese, 2 Finnish, and 1 English group participated in the cognition tests. Regarding cognition, the correct answer ratios were higher in audio-visual than audio for all three… 
LANGUAGE EFFECTS ON THE DEGREE OF VISUAL INFLUENCE IN AUDIOVISUAL SPEECH PERCEPTION
This study investigated language factors in the use of visual information in auditory-visual speech perception in Mandarin-Chinese, Thai, Japanese and English, four languages differing in the degree
Developmental factors and the non-native speaker effect in auditory-visual speech perception.
  • Yuchun Chen, V. Hazan
  • Psychology, Linguistics
    The Journal of the Acoustical Society of America
  • 2009
TLDR
The results showed an increase in the use of visual information in adults relative to children in both the Chinese and English groups, and there was evidence for a "non-native speaker effect" (i.e., stronger visual effect for non-native speech stimuli), but only for the English participants.
Respiratory and Respiratory Muscular Control in JL1's and JL2's Text Reading Utilizing 4-RSTs and a Soft Respiratory Mask with a Two-Way Bulb
TLDR
Text reading speed was more stable in L1 than in L2, and the lower abdomen was controllable, which may indicate “stomach respiration,” and the vital capacity volume did not sufficiently correlate with the subjects’ expiratory and inspiratory air volume during speech.

References

A cross-cultural investigation of emotion inferences from voice and speech: implications for speech technology
TLDR
This contribution describes the first large-scale effort to obtain empirical data on whether the vocal changes produced by emotional and attitudinal factors are universal or vary over cultures and/or languages by studying emotion recognition from voice in nine countries on three different continents.