Put a grammar here: bi-directional parsing in multimodal interaction

@inproceedings{Rudzicz2006PutAG,
  title={Put a grammar here: bi-directional parsing in multimodal interaction},
  author={Frank Rudzicz},
  booktitle={CHI Extended Abstracts},
  year={2006}
}
Despite over two decades of research, no dominant paradigm has yet emerged to generically represent language in multimodal interaction (MMI). A commonality amongst many divergent approaches, however, is an apparent reluctance to treat multimodal language as a unique linguistic phenomenon, which results in computational models retrofitted to older approaches, and integration engines tied to their application. In this paper we present the GS Algorithm - a new grammar-based unification parser for… CONTINUE READING