From raw images of the lips to articulatory parameters: a viseme-based prediction

@inproceedings{Revret1997FromRI,
  title={From raw images of the lips to articulatory parameters: a viseme-based prediction},
  author={Lionel Rev{\'e}ret},
  booktitle={EUROSPEECH},
  year={1997}
}
This paper presents a method for the extraction of articulatory parameters from direct processing of raw images of the lips. The system architecture is made of three independent parts. First, a new greyscale mouth image is centred and downsampled. Second, the image is aligned and projected onto a basis of artificial images. These images are the eigenvectors computed from a PCA applied on a set of 23 reference lip shapes. Then, a multilinear interpolation predicts articulatory parameters from… CONTINUE READING
7 Citations
12 References
Similar Papers

References

Publications referenced by this paper.
Showing 1-10 of 12 references

A set of Talking French visemes for visual speech synthesis'', in Machines : Theories, Models and Designs

  • C. Benoît, M. T. Lallouache, C. Abry
  • Elsevier Science Publishers,
  • 1992
Highly Influential
3 Excerpts

On the Integration of Auditory and Visual Parameters in an HMM-based ASR'', in Speechreading by Humans and Machines

  • A. Adjoudani, C. Benoît
  • 1996
1 Excerpt

Eigenlips for Robust Speech ICASSP'94, Adelaide

  • C. Bregler, Y. Konig
  • 1994
2 Excerpts

PCA Image Coding Proc. of the Schemes and Visual Speech Intelligibility'', in Institute of Acoustics

  • N. M. Brooke, S. D. Scott
  • Autumn Meeting, Windermere, UK,
  • 1994
1 Excerpt

Automatic Lipreading by in Systems and Computers in Japan Optical-Flow Analysis'

  • K. Mase, A. Pentland
  • vol. 22,
  • 1991
1 Excerpt

Similar Papers

Loading similar papers…