The role of natural language in a multimodal interface

  title={The role of natural language in a multimodal interface},
  author={Philip R. Cohen},
  booktitle={UIST '92},
Although graphics and direct manipulation are effective interface technologies for some classes of problems, they are limited in many ways. In particular, they provide little support for identifying objects not on the screen, for specifying temporal relations, for identifying and operating on large sets and subsets of entities, and for using the context of interaction. On the other hand, these are precisely strengths of natural language. This paper presents an interface that blends natural… Expand
Eucalyptus: Integrating Natural Language Input with a Graphical User Interface
The history and future of direct manipulation
  • D. Frohlich
  • Engineering, Computer Science
  • Behav. Inf. Technol.
  • 1993
Human-computer interaction through natural language and hypermedia in AlFresco
Multimodal Interaction for Information Access: Exploiting Cohesion
An improved interface for tutorial dialogues: browsing a visual dialogue history
Multimedia Interfaces: Designing for Diversity
HALPIN: A Natural Language Information Retrieval System for a Digital Library on the World Wide Web