Dyna: a model of dynamic human shape in motion

@article{PonsMoll2015DynaAM,
  title={Dyna: a model of dynamic human shape in motion},
  author={Gerard Pons-Moll and Javier Romero and Naureen Mahmood and Michael J. Black},
  journal={ACM Trans. Graph.},
  year={2015},
  volume={34},
  pages={120:1-120:14}
}
To look human, digital full-body avatars need to have soft-tissue deformations like those of real people. We learn a model of soft-tissue deformations from examples using a high-resolution 4D capture system and a method that accurately registers a template mesh to sequences of 3D scans. Using over 40,000 scans of ten subjects, we learn how soft-tissue motion causes mesh triangles to deform relative to a base 3D body model. Our Dyna model uses a low-dimensional linear subspace to approximate… Expand
Data-driven physics for human soft tissue animation
TLDR
The learned two layer model is a realistic full-body avatar that generalizes to novel motions and external forces and supports the retargeting of physical properties from one avatar when they share the same topology. Expand
Dynamic skin deformation simulation using musculoskeletal model and soft tissue dynamics
TLDR
An algorithm is presented that generates natural, dynamic, and detailed skin deformation (movement and jiggle) from joint angle data sequences that are quantitatively and qualitatively similar to measured actual skin deformations. Expand
Modeling and Estimation of Nonlinear Skin Mechanics for Animated Avatars
TLDR
A hybrid model in which the soft‐tissue deformation of animated avatars is built as a combination of a data‐driven statistical model, which kinematically drives the animation, an FEM mechanical simulation and a custom anisotropic nonlinear material to accurately represent skin dynamics. Expand
Efficient Pose Deformations for Human Models in Customized Sizes and Shapes
5 Modelling dynamic pose deformations of human subjects is an important topic in many research applications. Existing approaches of human pose deformations can be classified as volume-based, skeletalExpand
Learning Nonlinear Soft-Tissue Dynamics for Interactive Avatars
TLDR
A novel method to enrich existing vertex-based human body models by adding soft-tissue dynamics, which learns to predict per-vertex 3D offsets that reproduce nonlinear mesh deformation effects as a function of pose information, enabling the synthesis of realistic 3D mesh animations. Expand
Pose-space subspace dynamics
TLDR
This work demonstrates how to perform multi-model reduction of Finite Element Method (FEM) nonlinear elasticity, where separate reduced models are precomputed around a representative set of object poses, and then combined at runtime into a single fast dynamic system, using subspace interpolation. Expand
Measuring, modelling, simulating, and predicting human tissue properties
TLDR
It is shown that mechanical properties of the human body can be directly measured using a novel hand-held device, and a complete pipeline for measurement, modeling, parameter estimation, and simulation is described. Expand
Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodies
TLDR
A unified deformation model is presented for the markerless capture of human movement at multiple scales, including facial expressions, body motion, and hand gestures, which enables the full expression of part movements by a single seamless model. Expand
High-Detail Animation of Human Body Shape and Pose From High-Resolution 4D Scans Using Iterative Closest Point and Shape Maps
In this article, we present a method of analysis for 3D scanning sequences of human bodies in motion that allows us to obtain a computer animation of a virtual character containing both skeletonExpand
Multi-frame sequence generator of 4D human body motion
TLDR
A generative auto-encoder-based framework, which encodes morphology, global locomotion including translation and rotation, and multi-frame temporal motion as a single latent space vector is proposed, showing promising abilities of the model to learn realistic spatio-temporal features of human motion. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 51 REFERENCES
A Statistical Model of Human Pose and Body Shape
TLDR
A unified model that describes both, human pose and body shape is introduced which allows us to accurately model muscle deformations not only as a function of pose but also dependent on the physique of the subject. Expand
Capture and Statistical Modeling of Arm‐Muscle Deformations
TLDR
A comprehensive data‐driven statistical model for skin and muscle deformation of the human shoulder‐arm complex is presented, fast, compact and controllable with a small set of intuitive parameters – pose, body shape and external forces, through which a novice artist can interactively produce complex muscle deformations. Expand
Breathing life into shape
TLDR
A novel non-linear model relating volume and breathing type to 3D shape deformations and pose changes and an intuitive interface with which animators can synthesize 3D human avatars with realistic breathing motions are developed. Expand
Capturing and animating skin deformation in human motion
TLDR
The power of this approach is demonstrated by capturing flexing muscles, high frequency motions, and abrupt decelerations on several actors, both to conventional motion capture and skinning and to synchronized video of the actors. Expand
Data-driven modeling of skin and muscle deformation
TLDR
A data-driven technique for synthesizing skin deformation from skeletal motion by generating skin deformations from the skeletal motion of an actor and comparing the generated animation both to synchronized video of the actor and to ground truth animation created directly from the large marker set. Expand
The space of human body shapes: reconstruction and parameterization from range scans
TLDR
With this parameterized set, a variety of applications for human body modeling are explored, including: morphing, texture transfer, statistical analysis of shape, model fitting from sparse markers, feature analysis to modify multiple correlated parameters, and transfer of surface detail and animation controls from a template to fitted models. Expand
EigenSkin: real time large deformation character skinning in hardware
We present a technique which allows subtle nonlinear quasi-static deformations of articulated characters to be compactly approximated by data-dependent eigenbases which are optimized for real timeExpand
Comprehensive biomechanical modeling and simulation of the upper body
TLDR
A comprehensive biomechanical model of the human upper body and an associated physics-based animation controller that computes the muscle activation signals necessary to drive the elaborate musculoskeletal system in accordance with a sequence of target poses specified by an animator are introduced. Expand
Tensor-Based Human Body Modeling
TLDR
A novel approach to model 3D human body with variations on both human shape and pose, by exploring a tensor decomposition technique, which outperforms the SCAPE model quite significantly. Expand
Automatic determination of facial muscle activations from sparse motion capture marker data
TLDR
An anatomically accurate model of facial musculature, passive tissue and underlying skeletal structure using volumetric data acquired from a living male subject and can be used in a robust simulation framework including contact and collision of the face with external objects. Expand
...
1
2
3
4
5
...