• Corpus ID: 27325445

3D Facial Expression Reconstruction using Cascaded Regression

@article{Wu20173DFE,
  title={3D Facial Expression Reconstruction using Cascaded Regression},
  author={Fanzi Wu and Songnan Li and Tianhao Zhao and King Ngi Ngan},
  journal={ArXiv},
  year={2017},
  volume={abs/1712.03491}
}
This paper proposes a novel model fitting algorithm for 3D facial expression reconstruction from a single image. Face expression reconstruction from a single image is a challenging task in computer vision. Most state-of-the-art methods fit the input image to a 3D Morphable Model (3DMM). These methods need to solve a stochastic problem and cannot deal with expression and pose variations. To solve this problem, we adopt a 3D face expression model and use a combined feature which is robust to… 

Figures and Tables from this paper

MVF-Net: Multi-View 3D Face Morphable Model Regression

  • Fanzi WuLinchao Bao W. Liu
  • Computer Science
    2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2019
A novel approach is proposed to regress 3DMM parameters from multi-view inputs with an end-to-end trainable Convolutional Neural Network (CNN).

Facial Action Unit Analysis through 3D Point Cloud Neural Networks

This work experiments with recent successful architectures and proposes a new architecture, Local Continuous PointNet (LCPN), for unordered 3D point cloud analysis to detect Action Units (AUs) in the BP4D-Spontaneous database and is believed to be the first work that directly processes unordered3D point clouds in a neural network for facial expression analysis.

End-to-End Deep Kronecker-Product Matching for Person Re-identification

A novel Kronecker Product Matching module to match feature maps of different persons in an end-to-end trainable deep neural network that outperforms state-of-the-art methods on the Market-1501, CUHK03, and DukeMTMC datasets, which demonstrates the effectiveness and generalization ability of the proposed approach.

Person Re-identification with Deep Similarity-Guided Graph Neural Network

This paper proposes a novel deep learning framework, named Similarity-Guided Graph Neural Network (SGGNN), which learns the edge weights with rich labels of gallery instance pairs directly, which provides relation fusion more precise information.

References

SHOWING 1-10 OF 29 REFERENCES

A 3D Face Model for Pose and Illumination Invariant Face Recognition

This paper publishes a generative 3D shape and texture model, the Basel Face Model (BFM), and demonstrates its application to several face recognition task and publishes a set of detailed recognition and reconstruction results on standard databases to allow complete algorithm comparisons.

3D Face Reconstruction from a Single Image Using a Single Reference Face Shape

This work proposes a novel method for 3D shape recovery of faces that exploits the similarity of faces, and obtains as input a single image and uses a mere single 3D reference model of a different person's face.

Discriminative 3D morphable model fitting

Compared with the traditional analysis-by-synthesis framework, the new discriminative approach makes it possible to utilize large databases to train a robust fitting model which can reconstruct shape from image features accurately and efficiently.

A morphable model for the synthesis of 3D faces

A new technique for modeling textured 3D faces by transforming the shape and texture of the examples into a vector space representation, which regulates the naturalness of modeled faces avoiding faces with an “unlikely” appearance.

Face Recognition Based on Fitting a 3D Morphable Model

This paper presents a method for face recognition across variations in pose, ranging from frontal to profile views, and across a wide range of illuminations, including cast shadows and specular

FaceWarehouse: A 3D Facial Expression Database for Visual Computing

There is a much richer matching collection of expressions, enabling depiction of most human facial actions, in FaceWarehouse, a database of 3D facial expressions for visual computing applications.

A Linear Approach of 3 D Face Shape and Texture Recovery using a 3 D Morphable Model

This paper learns empirically the generalization error of a 3D morphable model using out-of-sample data and incorporates this into a parameter-free probabilistic framework which allows 3D shape recovery of a face in an arbitrary pose in a single step.

Model-based face reconstruction using SIFT flow registration and spherical harmonics

A 3D morphable model is used to reconstruct a smooth 3D face shape using a single color image and depth values are refined using a shape from shading method which approximates lighting condition by spherical harmonics.

3D shape regression for real-time facial animation

A real-time performance-driven facial animation system based on 3D shape regression that learns an accurate, user-specific face alignment model from an easily acquired set of training data, generated from images of the user performing a sequence of predefined facial poses and expressions.

A Linear Approach to Face Shape and Texture Recovery using a 3D Morphable Model

This paper learns empirically the generalization error of a 3D morphable model using out-of-sample data and incorporates this into a parameter-free probabilistic framework which allows 3D shape recovery of a face in an arbitrary pose in a single step.