Visual Speech Synthesis by Morphing Visemes

@article{Ezzat2000VisualSS,
  title={Visual Speech Synthesis by Morphing Visemes},
  author={Tony Ezzat and Tomaso A. Poggio},
  journal={International Journal of Computer Vision},
  year={2000},
  volume={38},
  pages={45-57}
}
We present MikeTalk, a text-to-audiovisual speech synthesizer which converts input text into an audiovisual speech stream. MikeTalk is built using visemes, which are a small set of images spanning a large range of mouth shapes. The visemes are acquired from a recorded visual corpus of a human subject which is specifically designed to elicit one instantiation of each viseme. Using optical flow methods, correspondence from every viseme to every other viseme is computed automatically. By morphing… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 106 CITATIONS

Visual speech, a trajectory in viseme space

  • Int. J. Imaging Systems and Technology
  • 2003
VIEW 5 EXCERPTS
HIGHLY INFLUENCED

Generating Visemes for Realistic Animation

VIEW 6 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Acoustically-driven talking face animations using dynamic Bayesian networks

VIEW 5 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Defocus morphing in real aperture images.

  • Journal of the Optical Society of America. A, Optics, image science, and vision
  • 2005
VIEW 3 EXCERPTS
CITES METHODS
HIGHLY INFLUENCED

Image-based talking heads using radial basis functions

  • Proceedings of Theory and Practice of Computer Graphics, 2003.
  • 2003
VIEW 3 EXCERPTS
CITES RESULTS & METHODS
HIGHLY INFLUENCED

Realistic face animation for speech

  • Journal of Visualization and Computer Animation
  • 2002
VIEW 4 EXCERPTS
CITES METHODS
HIGHLY INFLUENCED

Morphable Models for the Analysis and Synthesis of Complex Motion Patterns

  • International Journal of Computer Vision
  • 2000
VIEW 6 EXCERPTS
CITES BACKGROUND & METHODS

FILTER CITATIONS BY YEAR

2000
2019

CITATION STATISTICS

  • 10 Highly Influenced Citations