Multimodal reference resolution for mobile spatial interaction in urban environments

@inproceedings{Moniri2012MultimodalRR,
  title={Multimodal reference resolution for mobile spatial interaction in urban environments},
  author={Mohammad Mehdi Moniri and Christian A. M{\"u}ller},
  booktitle={AutomotiveUI},
  year={2012}
}
We present results of a study on referring to the outside environment from within a moving vehicle. Reference resolution is the first necessary step in integrating the outside environment into the interactive system in the car. It is the problem of finding out which of the objects outside the users is interested in. In our study, we explored eye gaze, head pose, pointing gesture with a smart phone, and the user's view field. We implemented and tested everything in a moving vehicle in a real… CONTINUE READING