• Corpus ID: 18104997

A Corpus of Gesture-Annotated Dialogues for Monologue-to-Dialogue Generation from Personal Narratives

@inproceedings{Hu2016ACO,
  title={A Corpus of Gesture-Annotated Dialogues for Monologue-to-Dialogue Generation from Personal Narratives},
  author={Zhichao Hu and Michelle Dick and Chung-Ning Chang and Kevin K. Bowden and Michael Neff and Jean E. Fox Tree and Marilyn A. Walker},
  booktitle={LREC},
  year={2016}
}
Story-telling is a fundamental and prevalent aspect of human social behavior. In the wild, stories are told conversationally in social settings, often as a dialogue and with accompanying gestures and other nonverbal behavior. This paper presents a new corpus, the Story Dialogue with Gestures (SDG) corpus, consisting of 50 personal narratives regenerated as dialogues, complete with annotations of gesture placement and accompanying gesture forms. The corpus includes dialogues generated by human… 

Monolog to dialog generation for story telling

TLDR
This paper presents algorithms for converting a deep representation of a story into a dialogic storytelling, that can vary aspects of the telling, including the personality of the storytellers, and test whether dialogic storytellings are more engaging.

M2D: Monolog to Dialog Generation for Conversational Story Telling

TLDR
This paper presents algorithms for converting a deep representation of a story into a dialogic storytelling, that can vary aspects of the telling, including the personality of the storytellers, and test whether dialogic storytellings are more engaging.

Storytelling with Dialogue: A Critical Role Dungeons and Dragons Dataset

TLDR
The CRD3 dataset is collected from 159 Critical Role episodes transcribed to text dialogues, consisting of 398,682 turns, and it also includes corresponding abstractive summaries collected from the Fandom wiki.

PersonaBank: A Corpus of Personal Narratives and Their Story Intention Graphs

We present a new corpus, PersonaBank, consisting of 108 personal stories from weblogs that have been annotated with their Story Intention Graphs, a deep representation of the content of a story. We

A Verbal and Gestural Corpus of Story Retellings to an Expressive Embodied Virtual Character

TLDR
The corpus illustrates the variation in expressive behaviors produced by users interacting with embodied virtual characters, and the degree to which their gestures were influenced by the agent’s dynamic changes in personality-based expressive style.

A Visually-grounded First-person Dialogue Dataset with Verbal and Non-verbal Responses

TLDR
The results demonstrate that first-person vision helps neural network models correctly understand human intentions, and the production of non-verbal responses is a challenging task like that of verbal responses.

Coordinating Communication in the Wild: The Artwalk Dialogue Corpus of Pedestrian Navigation and Mobile Referential Communication

TLDR
The Artwalk Corpus is a collection of 48 mobile phone conversations between24 pairs of friends and 24 pairs of strangers performing a novel, naturalistically-situated referential communication task, designed to elicit entrainment and coordination of referring expressions between the dialogue participants and examine the effect of friendship on dialogue strategies.

A Multimodal Motion-Captured Corpus of Matched and Mismatched Extravert-Introvert Conversational Pairs

TLDR
The Personality Dyads Corpus is presented, consisting of multimodal data for three conversations between three personality-matched, two- person dyads, and includes personality profiles, ANVIL files containing speech transcriptions and the gestural annotations, and BVH files containing body and hand motion in 3D.

The Task2Dial Dataset: A Novel Dataset for Commonsense-enhanced Task-based Dialogue Grounded in Documents

TLDR
The Task2Dial dataset is described, a novel dataset of document-grounded task-based dialogues, where an Information Giver provides instructions (by consulting a document) to an Information Follower, so that the latter can successfully complete the task.

Task2Dial: A Novel Task and Dataset for Commonsense-enhanced Task-based Dialogue Grounded in Documents

TLDR
The Task2Dial dataset is described, a novel dataset of document-grounded task-based dialogues, where an Information Giver provides instructions (by consulting a document) to an Information Follower, so that the latter can successfully complete the task.

References

SHOWING 1-10 OF 36 REFERENCES

Generating Different Story Tellings from Semantic Representations of Narrative

TLDR
This paper presents an automatic method for converting from Scheherazade's story intention graph, a semantic representation, to the input required by the personage nlg engine, and provides some examples of story variations generated by personage.

PersonaBank: A Corpus of Personal Narratives and Their Story Intention Graphs

We present a new corpus, PersonaBank, consisting of 108 personal stories from weblogs that have been annotated with their Story Intention Graphs, a deep representation of the content of a story. We

Narrative Variations in a Virtual Storyteller

TLDR
Fabula Tales is a computational framework for a virtual storyteller that can tell the same story in different ways through the implementation of general narratological variations, such as varying direct vs. indirect speech, character voice (style), point of view, and focalization.

Generating Sentence Planning Variations for Story Telling

TLDR
The ES-TRANSLATOR is described, a computational language generator that has previously been applied only to fables, and quantitatively evaluate the domain independence of the EST by applying it to personal narratives from weblogs.

Gesture modeling and animation based on a probabilistic re-creation of speaker style

TLDR
A system that, with a focus on arm gestures, is capable of producing full-body gesture animation for given input text in the style of a particular performer, which was successfully validated in an empirical user study.

The Influence of Prosody on the Requirements for Gesture-Text Alignment

TLDR
People’s sensitivity to misalignments between gesture and spoken text is examined, varying both the gesture type and the prosodic emphasis, suggesting that agent designers may be able to “cheat” when it comes to maintaining tight synchronization between audio and gesture without a decrease in agent naturalness.

The automated design of believable dialogues for animated presentation teams

TLDR
A new style for presenting information is investigated and the notion of presentation teams which—rather than addressing the user directly—convey information in the style of performances to be observed by the user is introduced.

A Tool for Deep Semantic Encoding of Narrative Texts

TLDR
A novel, publicly available annotation tool for the semantic encoding of texts, especially those in the narrative domain, that can create formal propositions to represent spans of text, as well as temporal relations and other aspects of narrative.

Detecting Story Analogies from Annotations of Time, Action and Agency

TLDR
The Story Intention Graph is described as a model of narrative meaning that is amenable to both corpus annotation and computational inference and finds that such detection outperforms a propositional similarity metric in predicting human judgments of story similarity in the Aesop domain.

Automatic Attribution of Quoted Speech in Literary Narrative

TLDR
A method for identifying the speakers of quoted speech in natural-language textual stories by dividing the quotes into syntactic classes in order to leverage common discourse patterns, which enable rapid attribution for many quotes.