A model for multimodal representation and processing for reference resolution

Abstract

We present a model for dealing with designation activities of a user in multimodal systems. This model associates both a well defined language to each modality (NL, gesture, visual) and a mediator one. It takes into account several semantic features of modalities. Functions link objects from each modality to another, and allow reasoning and referent… (More)
DOI: 10.1145/1330572.1330578

Topics

2 Figures and Tables

Slides referencing similar topics