• Publications
  • Influence
Opt
Many graphics and vision problems can be expressed as non-linear least squares optimizations of objective functions over visual data, such as images and meshes. The mathematical descriptions of theseExpand
  • 16,824
  • 1009
  • PDF
Face2Face: real-time face capture and reenactment of RGB videos
TLDR
We present Face2Face, a novel approach for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). Expand
  • 513
  • 87
  • PDF
Monocular 3D Human Pose Estimation in the Wild Using Improved CNN Supervision
TLDR
We propose a CNN-based approach for 3D human body pose estimation from single RGB images that addresses the issue of limited generalizability of models trained solely on the starkly limited publicly available 3D pose data. Expand
  • 257
  • 71
  • PDF
Performance capture from sparse multi-view video
TLDR
This paper proposes a new marker-less approach to capturing human performances from multi-view video that combines the power of surface- and volume-based shape deformation techniques with a new mesh-based analysis-through-synthesis framework. Expand
  • 515
  • 45
  • PDF
MoFA: Model-Based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstruction
TLDR
In this work we propose a novel model-based deep convolutional autoencoder that addresses the highly challenging problem of reconstructing a 3D human face from a single in-the-wild color image. Expand
  • 224
  • 45
  • PDF
GANerated Hands for Real-Time 3D Hand Tracking from Monocular RGB
TLDR
We address the highly challenging problem of real-time 3D hand tracking based on a monocular RGB-only sequence. Expand
  • 196
  • 43
  • PDF
VNect: real-time 3D human pose estimation with a single RGB camera
TLDR
We present the first real-time method to capture the full global 3D skeletal pose of a human in a stable, temporally consistent manner using a single RGB camera. Expand
  • 478
  • 42
  • PDF
BundleFusion: Real-Time Globally Consistent 3D Reconstruction Using On-the-Fly Surface Reintegration
TLDR
Real-time, high-quality, 3D scanning of large-scale scenes is key to mixed reality and robotic applications. Expand
  • 195
  • 31
  • PDF
Interactive Markerless Articulated Hand Motion Tracking Using RGB and Depth Data
TLDR
We present a novel method that can capture a broad range of articulated hand motions in the form of a kinematic skeleton at interactive rates. Expand
  • 213
  • 30
  • PDF
VolumeDeform: Real-Time Volumetric Non-rigid Reconstruction
TLDR
We present a novel approach for the reconstruction of dynamic geometric shapes using a single hand-held consumer-grade RGB-D sensor at real-time rates. Expand
  • 191
  • 27
  • PDF