Face2Face: Real-Time Face Capture and Reenactment of RGB Videos

  title={Face2Face: Real-Time Face Capture and Reenactment of RGB Videos},
  author={Justus Thies and M. Zollh{\"o}fer and M. Stamminger and C. Theobalt and M. Nie{\ss}ner},
  journal={2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
  • Justus Thies, M. Zollhöfer, +2 authors M. Nießner
  • Published 2016
  • Computer Science
  • 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • We present a novel approach for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video. [...] Key Method At run time, we track facial expressions of both source and target video using a dense photometric consistency measure. Reenactment is then achieved by fast and efficient deformation transfer between source and target. The mouth interior that best matches the re-targeted expression is retrieved from the target sequence and warped to produce an accurate fit. Finally, we…Expand Abstract
    83 Citations
    Makeup Lamps: Live Augmentation of Human Faces via Projection
    • 36
    • PDF
    A video prediction approach for animating single face image
    • 3
    Facial Reenactment Project Plan
    • Dr. Dirk Scheiders
    • 2016
    • PDF
    Neural style-preserving visual dubbing
    • 17
    • PDF
    Towards Photo-Realistic Facial Expression Manipulation
    • 1
    From 2D to 3D real-time expression transfer for facial animation
    Speech2Video Synthesis with 3D Skeleton Regularization and Expressive Body Poses
    • PDF


    Demo of Face2Face: real-time face capture and reenactment of RGB videos
    • 82
    • PDF
    Real-time expression transfer for facial reenactment
    • 226
    • PDF
    Demo of FaceVR: real-time facial reenactment and eye gaze control in virtual reality
    • 50
    • PDF
    Automatic Face Reenactment
    • 100
    • PDF
    Video face replacement
    • 168
    • Highly Influential
    • PDF
    Reconstructing detailed dynamic face geometry from monocular video
    • 178
    • PDF
    Realtime facial animation with on-the-fly correctives
    • 246
    • PDF
    Automatic acquisition of high-fidelity facial performances using monocular videos
    • 125
    • Highly Influential
    • PDF
    Face/Off: live facial puppetry
    • 215
    • PDF
    Real-time high-fidelity facial performance capture
    • 177
    • PDF