Unification-based Multimodal Parsing

  title={Unification-based Multimodal Parsing},
  author={Michael Johnston},
In order to realize their full potential, multimodal systems need to support not just input from multiple modes, but also synchronized integration of modes. Johnston et al (1997) model this integration using a unification operation over typed feature structures. This is an effective solution for a broad class of systems, but limits multimodal utterances to combinations of a single spoken phrase with a single gesture. We show how the unification-based approach can be scaled up to provide a full… CONTINUE READING
Highly Influential
This paper has highly influenced 13 other papers. REVIEW HIGHLY INFLUENTIAL CITATIONS
Highly Cited
This paper has 160 citations. REVIEW CITATIONS
102 Extracted Citations
24 Extracted References
Similar Papers

Citing Papers

Publications influenced by this paper.
Showing 1-10 of 102 extracted citations

160 Citations

Citations per Year
Semantic Scholar estimates that this publication has 160 citations based on the available data.

See our FAQ for additional information.

Referenced Papers

Publications referenced by this paper.
Showing 1-10 of 24 references

Confirma - tion in multimodal systems

  • S. K. Chang, T. Ichikawa, P. A. Ligomenides
  • 1998

Finite state language

  • E. Press. Chicago. Roche, Y. Schabes
  • 1997
1 Excerpt

Integra - tion and synchronization of input modes during multi - modal human - computer interaction

  • S. L. Oviatt, A. DeAngeli
  • 1997

Intelligent User Interfaces, ACM Press, Addison Wesley, New York, 45-68

  • S. W. Tyler eds
  • 1996

Predictive parsing for unordered relational languages

  • M. Tomita
  • Recent Advances in Parsing Technologies
  • 1996

Constructions: A Construction Grammar Approach to Argument Structure

  • A. Goldberg
  • University of Chicago Press, Chicago.
  • 1995
1 Excerpt

ModSAF development status

  • A. J. Courtemanche, A. Ceranowicz.
  • Proceedings of the 5th Conference on Computer…
  • 1995

Similar Papers

Loading similar papers…