Feature Decomposition and Reconstruction Learning for Effective Facial Expression Recognition

  title={Feature Decomposition and Reconstruction Learning for Effective Facial Expression Recognition},
  author={Delian Ruan and Yan Yan and Shenqi Lai and Zhenhua Chai and Chunhua Shen and Hanzi Wang},
  journal={2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
  • D. Ruan, Yan Yan, +3 authors Hanzi Wang
  • Published 12 April 2021
  • Computer Science
  • 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
In this paper, we propose a novel Feature Decomposition and Reconstruction Learning (FDRL) method for effective facial expression recognition. We view the expression information as the combination of the shared information (expression similarities) across different expressions and the unique information (expression-specific variations) for each expression. More specifically, FDRL mainly consists of two crucial networks: a Feature Decomposition Network (FDN) and a Feature Reconstruction Network… Expand

Figures and Tables from this paper

Disentangled-region non-local neural network for facial expression recognition
  • Xiaoyun Tong, Songlin Sun, Meixia Fu
  • Computer Science, Engineering
  • J. Electronic Imaging
  • 2021
This work proposes a disentangled-region non-local (DRNL) neural network, which can capture the long-range dependencies directly by calculating the interaction between the pixel and the region, not limited to the adjacent pixels, to maintain more information. Expand
A Robust Facial Expression Recognition Algorithm Based on Multi-Rate Feature Fusion Scheme
  • Seo-Jeon Park, Byung-Gyu Kim, N. Chilamkurti
  • Medicine, Computer Science
  • Sensors
  • 2021
A robust multi-depth network that can efficiently classify the facial expression through feeding various and reinforced features is proposed that outperformed other state-of-the-art models with accuracies. Expand


Reliable Crowdsourcing and Deep Locality-Preserving Learning for Unconstrained Facial Expression Recognition
A new deep locality-preserving convolutional neural network (DLP-CNN) method that aims to enhance the discriminative power of deep features by preserving the locality closeness while maximizing the inter-class scatter is proposed. Expand
Static facial expression analysis in tough conditions: Data, evaluation protocol and benchmark
A person independent training and testing protocol for expression recognition as part of the BEFIT workshop is proposed and a new static facial expression database Static Facial Expressions in the Wild (SFEW) is presented. Expand
Web-based database for facial expression analysis
The MMI facial expression database is presented, which includes more than 1500 samples of both static images and image sequences of faces in frontal and in profile view displaying various expressions of emotion, single and multiple facial muscle activation. Expand
Deep Residual Learning for Image Recognition
This work presents a residual learning framework to ease the training of networks that are substantially deeper than those used previously, and provides comprehensive empirical evidence showing that these residual networks are easier to optimize, and can gain accuracy from considerably increased depth. Expand
Deep Disturbance-Disentangled Learning for Facial Expression Recognition
This paper proposes a novel Deep Disturbance-disentangled Learning (DDL) method for FER that is capable of simultaneously and explicitly disentangling multiple disturbing factors by taking advantage of multi-task learning and adversarial transfer learning. Expand
Region Attention Networks for Pose and Occlusion Robust Facial Expression Recognition
A novel Region Attention Network (RAN), to adaptively capture the importance of facial regions for occlusion and pose variant FER, and a region biased loss to encourage high attention weights for the most important regions. Expand
Suppressing Uncertainties for Large-Scale Facial Expression Recognition
Self-Cure Network suppresses the uncertainty from two different aspects: 1) a self-attention mechanism over FER dataset to weight each sample in training with a ranking regularization, and 2) a careful relabeling mechanism to modify the labels of these samples in the lowest-ranked group. Expand
Deep multi-path convolutional neural network joint with salient region attention for facial expression recognition
A novel model, named Deep Attentive Multi-path Convolutional Neural Network (DAM-CNN), that can automatically locate expression-related regions in an expressional image and yield a robust image representation for FER. Expand
Identity- and Pose-Robust Facial Expression Recognition through Adversarial Feature Learning
An adversarial feature learning method to address both pose variations or identity bias and the superiority of the proposed method to state-of-the-art work is demonstrated. Expand
Covariance Pooling for Facial Expression Recognition
The benefits of using a manifold network structure for covariance pooling to improve facial expression recognition are explored and the advantage of pooling image-set features temporally by stacking the designed manifold network of covariance Pooling on top of convolutional network layers is demonstrated. Expand