Measuring Acoustic-Prosodic Entrainment with Respect to Multiple Levels and Dimensions

@inproceedings{Levitan2011MeasuringAE,
  title={Measuring Acoustic-Prosodic Entrainment with Respect to Multiple Levels and Dimensions},
  author={Rivka Levitan and Julia Hirschberg},
  booktitle={Interspeech},
  year={2011}
}
In conversation, speakers become more like each other in various dimensions. This phenomenon, commonly called entrainment, coordination, or alignment, is widely believed to be crucial to the success and naturalness of human interactions. We investigate entrainment in four acoustic and prosodic dimensions. We explore whether speakers coordinate with each other in these dimensions over the conversation as a whole as well as on a turn-by-turn basis and in both relative and absolute terms, and… 
View via Publisher
cs.columbia.edu
253 Citations
Highly Influential Citations
34
Background Citations
157
Methods Citations
40
Results Citations
22

Figures and Tables from this paper

253 Citations

Entrainment in Multi-Party Spoken Dialogues at Multiple Linguistic Levels

This paper measures lexical and acoustic-prosodic entrainment for multi-party teams to explore whether entrainments occurs at multiple levels during conversation and to understand the relationship between these two modalities.

Individual differences in acoustic-prosodic entrainment in spoken dialogue

Looking for Structure in Lexical and Acoustic-Prosodic Entrainment Behaviors

A negative result is presented, finding no meaningful correlations, clusters, or principal components in various entrainment measures, and practical and theoretical implications are discussed.

Prosodic Entrainment in Mandarin and English: A Cross-Linguistic Comparison

Entrainment is the propensity of speakers to begin behaving like one another in conversation. We identify evidence of entrainment in a number of acoustic and prosodic dimensions in conversational…

Implementing Acoustic-Prosodic Entrainment in a Conversational Avatar

An architecture and algorithm for implementing acoustic-prosodic entrainment in SDS is presented and it is shown that speech produced under this algorithm conforms to the feature targets, satisfying the properties ofEntrainment behavior observed in human-human conversations.

Three ToBI-based measures of prosodic entrainment and their correlations with speaker engagement

This study presents three novel measures of prosodic entrainment based on intonational contours as defined by the ToBI conventions for prosodic description, and reports significant correlations between each of these measures and manual annotations of a number of social variables related to the level of engagement of speakers.

Absolute and relative entrainment in Mandarin conversations

Evidence for the existence of two kinds of entrainment in Mandarin conversations is identified, Absolute entrainments in prosody is found at the levels of conversation and turn, and relative entrainedment is found over tones.

Acoustic-Prosodic Entrainment in Multi-party Spoken Dialogues: Does Simple Averaging Extend Existing Pair Measures Properly?

This study analyzes an existing approach of extending pair measures to team-level entrainment measures, which is based on simple averaging of pairs and argues that although simple averaging is a good starting point to measure teamEntrainment, it has several weaknesses in terms of capturing team-specific behaviors specifically related to convergence.

A Discriminative Acoustic-Prosodic Approach for Measuring Local Entrainment

An approach for measuring local entrainment that quantifies alignment of behavior on a turn-by-turn basis, projecting the differences between interlocutors' acoustic-prosodic features for a given turn onto a discriminative feature subspace that maximizes the difference between real and sham conversations.

Phonetic Entrainment in Cooperative Dialogues: A Case of Russian

Data on speech entrainment in Russian is presented using the standard measures for speechEntrainment: proximity, convergence and synchrony, which uses 49 dialogues from the SibLing speech corpus where speakers played a card-matching game.
...

References

SHOWING 1-9 OF 9 REFERENCES

High Frequency Word Entrainment in Spoken Dialogue

The results show that such entrainment is predictive of the perceived naturalness of dialogues and is significantly correlated with task success; in overall interaction flow, higher degrees ofEntrainment are associated with more overlaps and fewer interruptions.

Pause and gap length in face-to-face interaction

New approaches to measuring interlocutor similarity in spoken dialogue are proposed in terms of convergence and synchrony and approaches to capture these are proposed, illustrating the techniques on gap and pause production in Swedish spontaneous dialogues.

Amplitude convergence in children²s conversational speech with animated personas

Analysis of children’s speech to different animated characters revealed a 29% average change in energy when they spoke to an extroverted loud software partner (E), compared with an introverted soft-spoken one (I).

Quantification of prosodic entrainment in affective spontaneous spoken interactions of married couples

This work quantifies one aspect of interaction synchrony prosodic entrainment, specifically pitch and energy, in married couples’ problem-solving interactions using speech signal-derived measures and demonstrates that some of these measures capture useful information.

On phonetic convergence during conversational interaction.

The results suggest that talkers in conversational settings are susceptible to phonetic convergence, which can mark nonlinguistic functions in social discourse and can form the basis for phenomena such as accent change and dialect formation.

Pitch similarity in the vicinity of backchannels

Dynamic modeling of spoken dialogue seeks to capture how interlocutors change their speech over the course of a conversation. Much work has focused on how speakers adapt or entrain to different asp…

Predicting Success in Dialogue

It is shown that the relevant repetition tendency is based on slow adaptation rather than short-term priming and that lexical and syntactic repetition is a reliable predictor of task success given the first five minutes of a taskoriented dialogue.

Automatically measuring lexical and acoustic/prosodic convergence in tutorial dialog corpora

We use language technology to develop corpus measures of lexical and acoustic/prosodic convergence. We show that these measures successfully discriminate randomized from naturally ordered data, and…

Linguistic Style Matching in Social Interaction

Three experiments were conducted to determine the psychometric properties of language in dyadic interactions. Using text-analysis, it was possible to assess the degree to which people coordinate…