Measuring Acoustic-Prosodic Entrainment with Respect to Multiple Levels and Dimensions

@inproceedings{Levitan2011MeasuringAE,
  title={Measuring Acoustic-Prosodic Entrainment with Respect to Multiple Levels and Dimensions},
  author={Rivka Levitan and Julia Hirschberg},
  booktitle={INTERSPEECH},
  year={2011}
}
In conversation, speakers become more like each other in various dimensions. This phenomenon, commonly called entrainment, coordination, or alignment, is widely believed to be crucial to the success and naturalness of human interactions. We investigate entrainment in four acoustic and prosodic dimensions. We explore whether speakers coordinate with each other in these dimensions over the conversation as a whole as well as on a turn-by-turn basis and in both relative and absolute terms, and… 

Figures and Tables from this paper

Entrainment in Multi-Party Spoken Dialogues at Multiple Linguistic Levels
TLDR
This paper measures lexical and acoustic-prosodic entrainment for multi-party teams to explore whether entrainments occurs at multiple levels during conversation and to understand the relationship between these two modalities.
Acoustic-prosodic entrainment in Slovak, Spanish, English and Chinese: A cross-linguistic comparison
TLDR
Evidence of a variety of forms of entrainment across all the languages studied is found, with some evidence of individual differences as well within the languages.
Looking for Structure in Lexical and Acoustic-Prosodic Entrainment Behaviors
TLDR
A negative result is presented, finding no meaningful correlations, clusters, or principal components in various entrainment measures, and practical and theoretical implications are discussed.
Implementing Acoustic-Prosodic Entrainment in a Conversational Avatar
TLDR
An architecture and algorithm for implementing acoustic-prosodic entrainment in SDS is presented and it is shown that speech produced under this algorithm conforms to the feature targets, satisfying the properties ofEntrainment behavior observed in human-human conversations.
Absolute and relative entrainment in Mandarin conversations
TLDR
Evidence for the existence of two kinds of entrainment in Mandarin conversations is identified, Absolute entrainments in prosody is found at the levels of conversation and turn, and relative entrainedment is found over tones.
Three ToBI-based measures of prosodic entrainment and their correlations with speaker engagement
TLDR
This study presents three novel measures of prosodic entrainment based on intonational contours as defined by the ToBI conventions for prosodic description, and reports significant correlations between each of these measures and manual annotations of a number of social variables related to the level of engagement of speakers.
Acoustic-Prosodic Entrainment in Multi-party Spoken Dialogues: Does Simple Averaging Extend Existing Pair Measures Properly?
TLDR
This study analyzes an existing approach of extending pair measures to team-level entrainment measures, which is based on simple averaging of pairs and argues that although simple averaging is a good starting point to measure teamEntrainment, it has several weaknesses in terms of capturing team-specific behaviors specifically related to convergence.
A Discriminative Acoustic-Prosodic Approach for Measuring Local Entrainment
TLDR
An approach for measuring local entrainment that quantifies alignment of behavior on a turn-by-turn basis, projecting the differences between interlocutors' acoustic-prosodic features for a given turn onto a discriminative feature subspace that maximizes the difference between real and sham conversations.
Phonetic Entrainment in Cooperative Dialogues: A Case of Russian
TLDR
Data on speech entrainment in Russian is presented using the standard measures for speechEntrainment: proximity, convergence and synchrony, which uses 49 dialogues from the SibLing speech corpus where speakers played a card-matching game.
...
1
2
3
4
5
...

References

SHOWING 1-9 OF 9 REFERENCES
High Frequency Word Entrainment in Spoken Dialogue
TLDR
The results show that such entrainment is predictive of the perceived naturalness of dialogues and is significantly correlated with task success; in overall interaction flow, higher degrees ofEntrainment are associated with more overlaps and fewer interruptions.
Pause and gap length in face-to-face interaction
TLDR
New approaches to measuring interlocutor similarity in spoken dialogue are proposed in terms of convergence and synchrony and approaches to capture these are proposed, illustrating the techniques on gap and pause production in Swedish spontaneous dialogues.
Amplitude convergence in children²s conversational speech with animated personas
TLDR
Analysis of children’s speech to different animated characters revealed a 29% average change in energy when they spoke to an extroverted loud software partner (E), compared with an introverted soft-spoken one (I).
Quantification of prosodic entrainment in affective spontaneous spoken interactions of married couples
TLDR
This work quantifies one aspect of interaction synchrony prosodic entrainment, specifically pitch and energy, in married couples’ problem-solving interactions using speech signal-derived measures and demonstrates that some of these measures capture useful information.
On phonetic convergence during conversational interaction.
  • J. Pardo
  • Linguistics
    The Journal of the Acoustical Society of America
  • 2006
TLDR
The results suggest that talkers in conversational settings are susceptible to phonetic convergence, which can mark nonlinguistic functions in social discourse and can form the basis for phenomena such as accent change and dialect formation.
Pitch similarity in the vicinity of backchannels
Dynamic modeling of spoken dialogue seeks to capture how interlocutors change their speech over the course of a conversation. Much work has focused on how speakers adapt or entrain to different asp
Predicting Success in Dialogue
TLDR
It is shown that the relevant repetition tendency is based on slow adaptation rather than short-term priming and that lexical and syntactic repetition is a reliable predictor of task success given the first five minutes of a taskoriented dialogue.
Automatically measuring lexical and acoustic/prosodic convergence in tutorial dialog corpora
We use language technology to develop corpus measures of lexical and acoustic/prosodic convergence. We show that these measures successfully discriminate randomized from naturally ordered data, and
Linguistic Style Matching in Social Interaction
Three experiments were conducted to determine the psychometric properties of language in dyadic interactions. Using text-analysis, it was possible to assess the degree to which people coordinate