A Three-Dimensional Model of Human Lip Motions Trained from Video

@inproceedings{Basu1997ATM,
  title={A Three-Dimensional Model of Human Lip Motions Trained from Video},
  author={Sumit Basu and Alex Pentland},
  year={1997}
}
We present a 3D model of human lips and develop a framework for training it from real data. The model starts o with generic physics speci ed with the nite element method and \learns" the correct physics through observations. The model's physics allow physically-based regularization between sparse observation points and the resulting set of deformations are used to derive the correct physical modes of the model. Preliminary results showing the model's ability to reconstruct lip shapes from… CONTINUE READING

From This Paper

Figures, tables, and topics from this paper.

Citations

Publications citing this paper.
Showing 1-10 of 24 extracted citations

References

Publications referenced by this paper.
Showing 1-10 of 15 references

The Finite Element Method in Structural and Continuum Mechanics

  • O. C. Zienkiewicz
  • 1967
Highly Influential
4 Excerpts

2D Deformable Models for Visual Speech Analysis

  • Tarcisio Coianiz, Lorenzo Torresani, Bruno Caprile
  • In NATO Advanced Study Institute: Speechreading…
  • 1995

Camera selfcalibration from one point correspondence

  • Ali Azarbayejani, Alex Pentland
  • Technical Report 341, MIT Media Lab Vision and…
  • 1995
1 Excerpt

On the Integration of Auditory and Visual Parameters in an HMM-based ASR

  • A. Adjoudani, C. Benoit
  • In NATO Advanced Study Institute: Speechreading…
  • 1995
2 Excerpts

Probability, Random Processes, and Estimation Theory for Engineers

  • Henry Stark, John W. Woods
  • 1994
1 Excerpt

Similar Papers

Loading similar papers…