Speech Animation Using Coupled Hidden Markov Models

@article{Xie2006SpeechAU,
  title={Speech Animation Using Coupled Hidden Markov Models},
  author={Lei Xie and Zhi-Qiang Liu},
  journal={18th International Conference on Pattern Recognition (ICPR'06)},
  year={2006},
  volume={1},
  pages={1128-1131}
}
We present a novel speech animation approach using coupled hidden Markov models (CHMMs). Different from the conventional HMMs that use a single state chain to model the audio-visual speech with tight inter-modal synchronization, we use the CHMMs to model the asynchrony, different discriminative abilities, and temporal coupling between the audio speech and the visual speech, which are important factors for animations looking natural. Based on the audio-visual CHMMs, visual animation parameters… CONTINUE READING

Figures, Tables, and Topics from this paper.

Citations

Publications citing this paper.
SHOWING 1-10 OF 14 CITATIONS

Utterance independent bimodal emotion recognition in spontaneous communication

  • EURASIP J. Adv. Sig. Proc.
  • 2011
VIEW 7 EXCERPTS
CITES METHODS
HIGHLY INFLUENCED

Language Independent Speech Driven Facial Animation

  • 2008 IEEE Region 10 and the Third international Conference on Industrial and Information Systems
  • 2008
VIEW 5 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Hybrid phoneme based clustering approach for audio driven facial animation

  • 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
  • 2012
VIEW 2 EXCERPTS
CITES METHODS

Synthesizing visual speech trajectory with minimum generation error

  • 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
  • 2011
VIEW 2 EXCERPTS
CITES METHODS

Rendering a personalized photo-real talking head from short video footage

  • 2010 7th International Symposium on Chinese Spoken Language Processing
  • 2010
VIEW 2 EXCERPTS
CITES METHODS

References

Publications referenced by this paper.
SHOWING 1-7 OF 7 REFERENCES

Context dependent viseme models for voice driven animation

  • Proceedings EC-VIP-MC 2003. 4th EURASIP Conference focused on Video/Image Processing and Multimedia Communications (IEEE Cat. No.03EX667)
  • 2003
VIEW 2 EXCERPTS

A coupled HMM for audio-visual speech recognition

  • 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing
  • 2002
VIEW 2 EXCERPTS

Voice puppetry

M. Brand
  • SIGGRAPH’99, Los Angeles, 1999, pp. 21–28.
  • 1999
VIEW 2 EXCERPTS

Coupled hidden Markov models for complex action recognition

  • Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition
  • 1997
VIEW 1 EXCERPT

Similar Papers

Loading similar papers…