Data-driven physics for human soft tissue animation

  title={Data-driven physics for human soft tissue animation},
  author={Meekyoung Kim and Gerard Pons-Moll and Sergi Pujades and Seungbae Bang and Jinwook Kim and Michael J. Black and Sung-Hee Lee},
  journal={ACM Transactions on Graphics (TOG)},
  pages={1 - 12}
Data driven models of human poses and soft-tissue deformations can produce very realistic results, but they only model the visible surface of the human body and cannot create skin deformation due to interactions with the environment. Physical simulations can generalize to external forces, but their parameters are difficult to control. In this paper, we present a layered volumetric human body model learned from data. Our model is composed of a data-driven inner layer and a physics-based external… 

Figures from this paper

Parametric Skeletons with Reduced Soft‐Tissue Deformations

With this method, it is easy to design expressive reduced models with efficient yet accurate force computations, without the need for training deformation examples, and the application is demonstrated to parametric models of human bodies, SMPL, and hands, MANO with interactive simulations of contact with nonlinear soft‐tissue deformation and skeletal response.

Learning Nonlinear Soft-Tissue Dynamics for Interactive Avatars

A novel method to enrich existing vertex-based human body models by adding soft-tissue dynamics, which learns to predict per-vertex 3D offsets that reproduce nonlinear mesh deformation effects as a function of pose information, enabling the synthesis of realistic 3D mesh animations.

Measuring, modelling, simulating, and predicting human tissue properties

It is shown that mechanical properties of the human body can be directly measured using a novel hand-held device, and a complete pipeline for measurement, modeling, parameter estimation, and simulation is described.

SoftSMPL: Data‐driven Modeling of Nonlinear Soft‐tissue Dynamics for Parametric Humans

SoftSMPL is presented, a learning‐based method to model realistic soft‐tissue dynamics as a function of body shape and motion with qualitative and quantitative improvements over existing methods.

Building Accurate Physics-based Face Models from Data

This work starts by building a volumetric model from magnetic resonance images of a neutral facial expression, and solves an inverse physics problem where mechanical properties of the face are learned from 3D scans, specifically heterogenous stiffness and prestrain.

The human touch

It is shown that mechanical properties of the human body can be directly measured using a novel hand-held device and a phenomenological model (the sliding thick skin model) is introduced that is effective for both simulation and parameter estimation.

Data-Driven Physical Face Inversion

This work proposes to use a simple finite element simulation approach for face animation, and presents a novel method for recovering the required simulation parameters in order to best match a real actor's face motion.

Scalable muscle-actuated human simulation and control

This work aims to build a comprehensive musculoskeletal model and its control system that reproduces realistic human movements driven by muscle contraction dynamics and demonstrates the predictive simulation of dynamic motor skills under anatomical conditions including bone deformity, muscle weakness, contracture, and the use of a prosthesis.



Dyna: a model of dynamic human shape in motion

The Dyna model realistically represents the dynamics of soft tissue for previously unseen subjects and motions and provides tools for animators to modify the deformations and apply them to new stylized characters.

Dynamic skin deformation simulation using musculoskeletal model and soft tissue dynamics

An algorithm is presented that generates natural, dynamic, and detailed skin deformation (movement and jiggle) from joint angle data sequences that are quantitatively and qualitatively similar to measured actual skin deformations.

Reconstructing personalized anatomical models for physics-based body animation

This work starts by building a template anatomical model of an average male which supports deformations due to both subject-specific variations: shapes and sizes of bones, muscles, and adipose tissues and 2) skeletal poses, and captures a set of 3D scans of an actor in various poses.

Data-driven modeling of skin and muscle deformation

A data-driven technique for synthesizing skin deformation from skeletal motion by generating skin deformations from the skeletal motion of an actor and comparing the generated animation both to synchronized video of the actor and to ground truth animation created directly from the large marker set.

Thin skin elastodynamics

A novel Eulerian representation of skin is proposed that avoids all the difficulties of constraining the skin to lie on the body surface by working directly on the surface itself.

Kinodynamic skinning using volume-preserving deformations

This work presents a new approach to character skinning where divergence-free vector fields induced by skeletal motion, describe the velocity of skin deformation, and applies a new stable technique to efficiently integrate points along their deformation trajectories.

Comprehensive biomechanical modeling and simulation of the upper body

A comprehensive biomechanical model of the human upper body and an associated physics-based animation controller that computes the muscle activation signals necessary to drive the elaborate musculoskeletal system in accordance with a sequence of target poses specified by an animator are introduced.

Physically-Based Character Skinning

A novel multi-layer model for physically-based character skinning using shape matching with oriented particles and a fast summation technique to simulate the elastic behavior of the skin model and a position-based constraint enforcement to handle collisions, volume conservation and the coupling of the skeleton with the deformable model.

Fast simulation of skeleton-driven deformable body characters

A well-coordinated combination of a reduced deformable body model with nonlinear finite elements, a linear-time algorithm for skeleton dynamics, and explicit integration can boost simulation speed to orders of magnitude faster than existing methods, while preserving modeling accuracy as much as possible.

Pose-space subspace dynamics

This work demonstrates how to perform multi-model reduction of Finite Element Method (FEM) nonlinear elasticity, where separate reduced models are precomputed around a representative set of object poses, and then combined at runtime into a single fast dynamic system, using subspace interpolation.