Graph-to-Graph Meaning Representation Transformations for Human-Robot Dialogue

  title={Graph-to-Graph Meaning Representation Transformations for Human-Robot Dialogue},
  author={Mitchell Abrams and Claire Bonial and L. Donatelli},
Introduction. This research forms part of a larger project focused on natural language understanding (NLU) in the development of a twoway human-robot dialogue system in the search and navigation domain. We leverage Abstract Meaning Representation (AMR) to capture and structure the semantic content of natural language instructions in a machine-readable, directed, acyclic graph (Banarescu et al., 2013). Two key challenges exist for NLU in this task: (i) how to effectively map AMR to a constrained… 

Figures and Tables from this paper

Dialogue-AMR: Abstract Meaning Representation for Dialogue
A schema that enriches Abstract Meaning Representation (AMR) in order to provide a semantic representation for facilitating Natural Language Understanding (NLU) in dialogue systems is described and an enhanced AMR that represents not only the content of an utterance, but the illocutionary force behind it, as well as tense and aspect is presented.
Builder, we have done it: Evaluating & Extending Dialogue-AMR NLU Pipeline for Two Collaborative Domains
A two-step natural language understanding (NLU) pipeline that incrementally tames the variation of unconstrained natural language input and maps to executable robot behaviors is adopted and improved upon.


Augmenting Abstract Meaning Representation for Human-Robot Dialogue
The design scheme presented here, though task-specific, is extendable for broad coverage of speech acts using AMR in future task-independent work.
Layers of Interpretation: On Grammar and Compositionality
This work argues for the more traditional hypothesis that sentence meaning, but not speaker meaning, is compositional, and accordingly that NLP systems would benefit from reusable, automatically derivable, taskindependent semantic representations which target sentence meaning.
Toward Abstractive Summarization Using Semantic Representations
This work focuses on the graph-tograph transformation that reduces the source semantic graph into a summary graph, making use of an existing AMR parser and assuming the eventual availability of an AMR-totext generator.
ISO 24617-2: A semantically-based standard for dialogue annotation
The design and implementation of an incremental method for dialogue act recognition, which proves the usability of the ISO standard for automatic dialogue annotation, is discussed.
Applying the Wizard-of-Oz Technique to Multimodal Human-Robot Dialogue
This work describes how the Wizard-of-Oz (WOz) method can be applied to multimodal human-robot dialogue in a collaborative exploration task, and considers two wizards to stand in for robot navigation and dialogue management software components.
Annotation of Tense and Aspect Semantics for Sentential AMR
The proposed framework augments the representation of finite predications to include a four-way temporal distinction and several aspectual distinctions that will enable AMR to be used for NLP tasks and applications that require sophisticated reasoning about time and event structure.
Abstract Meaning Representation for Sembanking
A sembank of simple, whole-sentence semantic structures will spur new work in statistical natural language understanding and generation, like the Penn Treebank encouraged work on statistical parsing.
Compositional Semantic Parsing across Graphbanks
A compositional neural semantic parser which achieves competitive accuracies across a diverse range of graphbanks for the first time, and incorporating BERT embeddings and multi-task learning improves the accuracy further.
Smatch: an Evaluation Metric for Semantic Feature Structures
This paper presents smatch, a metric that calculates the degree of overlap between two semantic feature structures, and gives an efficient algorithm to compute the metric and shows the results of an inter-annotator agreement study.
Speech Acts: An Essay in the Philosophy of Language
Part I. A Theory of Speech Acts: 1. Methods and scope 2. Expressions, meaning and speech acts 3. The structure of illocutionary acts 4. Reference as a speech act 5. Predication Part II. Some