Video Rewrite: driving visual speech with audio

@article{Bregler1997VideoRD,
  title={Video Rewrite: driving visual speech with audio},
  author={C. Bregler and M. Covell and M. Slaney},
  journal={Proceedings of the 24th annual conference on Computer graphics and interactive techniques},
  year={1997}
}
  • C. Bregler, M. Covell, M. Slaney
  • Published 1997
  • Computer Science
  • Proceedings of the 24th annual conference on Computer graphics and interactive techniques
  • Video Rewrite uses existing footage to create automatically new video of a person mouthing words that she did not speak in the original footage. This technique is useful in movie dubbing, for example, where the movie sequence can be modified to sync the actors’ lip motions to the new soundtrack. Video Rewrite automatically labels the phonemes in the training data and in the new audio track. Video Rewrite reorders the mouth images in the training footage to match the phoneme sequence of the new… CONTINUE READING
    677 Citations

    Figures and Topics from this paper

    Explore Further: Topics Discussed in This Paper

    Video rewrite: visual speech synthesis from video
    • 28
    • PDF
    Text-based editing of talking-head video
    • 56
    • PDF
    Text-based Editing of Talking-head Video
    Rendering a personalized photo-real talking head from short video footage
    • 2
    • PDF
    Sample-based synthesis of photo-realistic talking heads
    • E. Cosatto, H. Graf
    • Computer Science
    • Proceedings Computer Animation '98 (Cat. No.98EX169)
    • 1998
    • 106
    • PDF
    Joint Audio-Video Driven Facial Animation
    • 2
    • PDF
    An Image-Based Visual Speech Animation System
    • 23
    • Highly Influenced
    Audio-visual unit selection for the synthesis of photo-realistic talking-heads
    • E. Cosatto, G. Potamianos, H. Graf
    • Computer Science
    • 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532)
    • 2000
    • 41
    • PDF