GANerated Hands for Real-Time 3D Hand Tracking from Monocular RGB

@article{Mueller2017GANeratedHF,
  title={GANerated Hands for Real-Time 3D Hand Tracking from Monocular RGB},
  author={Franziska Mueller and Florian J. Bernard and Oleksandr Sotnychenko and Dushyant Mehta and Srinath Sridhar and Dan Casas and Christian Theobalt},
  journal={2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year={2017},
  pages={49-59}
}
We address the highly challenging problem of real-time 3D hand tracking based on a monocular RGB-only sequence. Our tracking method combines a convolutional neural network with a kinematic 3D hand model, such that it generalizes well to unseen data, is robust to occlusions and varying camera viewpoints, and leads to anatomically plausible as well as temporally smooth hand motions. For training our CNN we propose a novel approach for the synthetic generation of training data that is based on a… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 47 CITATIONS

Pushing the Envelope for RGB-based Dense 3D Hand Pose Estimation via Neural Rendering

VIEW 8 EXCERPTS
CITES METHODS, RESULTS & BACKGROUND
HIGHLY INFLUENCED

Articulated Human Pose Estimation in Unconstrained Images and Videos

VIEW 4 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Weakly-Supervised 3D Hand Pose Estimation from Monocular RGB Images

VIEW 10 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Disentangling Latent Hands for Image Synthesis and Pose Estimation

VIEW 8 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

3D Hand Shape and Pose Estimation from a Single RGB Image

  • CVPR 2019
  • 2019
VIEW 2 EXCERPTS
CITES BACKGROUND & METHODS

References

Publications referenced by this paper.
SHOWING 1-10 OF 63 REFERENCES

Learning to Estimate 3D Hand Pose from Single RGB Images

  • 2017 IEEE International Conference on Computer Vision (ICCV)
  • 2017
VIEW 16 EXCERPTS
HIGHLY INFLUENTIAL

Real-Time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor

  • 2017 IEEE International Conference on Computer Vision (ICCV)
  • 2017
VIEW 11 EXCERPTS
HIGHLY INFLUENTIAL

Adversarial Discriminative Domain Adaptation

  • 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2017
VIEW 1 EXCERPT

Back to RGB: 3D Tracking of Hands and Hand-Object Interactions Based on Short-Baseline Stereo

  • 2017 IEEE International Conference on Computer Vision Workshops (ICCVW)
  • 2017
VIEW 1 EXCERPT

Crossing Nets: Combining GANs and VAEs with a Shared Latent Space for Hand Pose Estimation

  • 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2017
VIEW 1 EXCERPT

Hand Keypoint Detection in Single Images Using Multiview Bootstrapping

  • 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2017
VIEW 3 EXCERPTS

Similar Papers