Multimodal Communication from Multimodal Thinking - towards an Integrated Model of Speech and Gesture Production

@article{Kopp2008MultimodalCF,
  title={Multimodal Communication from Multimodal Thinking - towards an Integrated Model of Speech and Gesture Production},
  author={Stefan Kopp and Kirsten Bergmann and Ipke Wachsmuth},
  journal={Int. J. Semantic Computing},
  year={2008},
  volume={2},
  pages={115-136}
}
A computational model for the automatic production of combined speech and iconic gesture is presented. The generation of multimodal behavior is grounded in processes of multimodal thinking, in which a propositional representation interacts and interfaces with an imagistic representation of visuo-spatial imagery. An integrated architecture for this is described, in which the planning of content and the planning of form across both modalities proceed in an interactive manner. Results from an… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 41 CITATIONS

References

Publications referenced by this paper.
SHOWING 1-10 OF 47 REFERENCES

The Production of Gesture and Speech, in D. McNeill (ed.), Language and gesture

  • J. de Ruiter
  • 2000
Highly Influential
4 Excerpts

Mental Imagery

  • N. Thomas
  • E. N. Zalta (ed.), The Stanford Encyclopedia of…
  • 2007

Similar Papers

Loading similar papers…