Automated Vocabulary Acquisition and Interpretation in Multimodal Conversational Systems

@inproceedings{Liu2007AutomatedVA,
  title={Automated Vocabulary Acquisition and Interpretation in Multimodal Conversational Systems},
  author={Yi Liu and Joyce Yue Chai and Rong Jin},
  booktitle={ACL},
  year={2007}
}
Motivated by psycholinguistic findings that eye gaze is tightly linked to human language production, we developed an unsupervised approach based on translation models to automatically learn the mappings between words and objects on a graphic display during human machine conversation. The experimental results indicate that user eye gaze can provide useful information to establish such mappings, which have important implications in automatically acquiring and interpreting user vocabularies for… CONTINUE READING
Highly Cited
This paper has 18 citations. REVIEW CITATIONS

From This Paper

Figures, tables, and topics from this paper.

Citations

Publications citing this paper.
Showing 1-10 of 12 extracted citations

References

Publications referenced by this paper.
Showing 1-10 of 14 references

Similar Papers

Loading similar papers…