Multimodal Interfaces

@inproceedings{Oviatt2008MultimodalI,
  title={Multimodal Interfaces},
  author={S. Oviatt},
  booktitle={Encyclopedia of Multimedia},
  year={2008}
}
  • S. Oviatt
  • Published in Encyclopedia of Multimedia 2008
  • Computer Science
Multimodal systems process two or more combined user input modes— such as speech, pen, touch, manual gestures, gaze, and head and body movements— in a coordinated manner with multimedia system output. This class of systems represents a new direction for computing, and a paradigm shift away from conventional WIMP interfaces. Since the appearance of Bolt’s (1980) “Put That There” demonstration system, which processed speech in parallel with touch-pad pointing, a variety of new multimodal systems… Expand
320 Citations

Figures and Topics from this paper

More Than Words: Designing Multimodal Systems
  • 3
Multimodal interaction systems: information and time features
  • 33
Multimodal Interaction with Computers
  • 1
Multimodal interfaces: Challenges and perspectives
  • N. Sebe
  • Computer Science
  • J. Ambient Intell. Smart Environ.
  • 2009
  • 57
  • PDF
Multimodal Interfaces of Human–Computer Interaction
  • 16
Using hand gestures to control mobile spoken dialogue systems
  • Nikos Tsourakis
  • Computer Science
  • Universal Access in the Information Society
  • 2013
  • 6
  • PDF
FIGI: floating interface for gesture-based interaction
  • 10
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 228 REFERENCES
Ten myths of multimodal interaction
  • 664
  • PDF
Perceptual user interfaces: multimodal interfaces that process what comes naturally
  • 261
  • PDF
Multimodal system processing in mobile environments
  • 109
Toward multimodal human-computer interface
  • 326
Building an application framework for speech and pen input integration in multimodal learning interfaces
  • M. Vo, Cindy Wood
  • Computer Science
  • 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings
  • 1996
  • 107
Multimodal Interfaces for Cell Phones and Mobile Technology
  • 8
Toward a theory of organized multimodal integration patterns during human-computer interaction
  • 111
  • PDF
Multimodal integration patterns in children
  • 41
  • PDF
Integration and Synchronization of Input Modes during Multimodal Human-Computer Interaction
  • 427
  • PDF
...
1
2
3
4
5
...