Multimodal interfaces for multimedia information agents

@inproceedings{Waibel1997MultimodalIF,
  title={Multimodal interfaces for multimedia information agents},
  author={Alexander H. Waibel and Bernhard Suhm and Minh Tue Vo and Jie Yang},
  booktitle={ICASSP},
  year={1997}
}
When lhumans communicate they take advantage of a rich spectrum of cues. Some arc: verbal and acoustic. Some are non-verbal and non-acoustic. Signal processing technology has devoted much attention to the recognition of speech, as a single human communication signal. Most other complementary communication cues, however, remain unexplored and unused in human-computer interaction. In this paper we show that the addition of non-acoustic or non-verbal cues can significantly enhance robustness… CONTINUE READING