Deep Learning Face Attributes in the Wild

  title={Deep Learning Face Attributes in the Wild},
  author={Ziwei Liu and Ping Luo and Xiaogang Wang and Xiaoou Tang},
  journal={2015 IEEE International Conference on Computer Vision (ICCV)},
  • Ziwei LiuPing Luo Xiaoou Tang
  • Published 27 November 2014
  • Computer Science
  • 2015 IEEE International Conference on Computer Vision (ICCV)
Predicting face attributes in the wild is challenging due to complex face variations. [] Key Result (3) It also demonstrates that the high-level hidden neurons of ANet automatically discover semantic concepts after pre-training with massive face identities, and such concepts are significantly enriched after fine-tuning with attribute tags. Each attribute can be well explained with a sparse linear combination of these concepts.

Face Attribute Prediction Using Off-The-Shelf Deep Learning Networks

This paper employs off-the-shelf CNNs trained for face recognition tasks to do facial feature extraction, combined with conventional face localization techniques, and suggests two potentially important questions in using CNNs for face attribute prediction: how to maximally leverage the power of CNN representations and how to best combine traditional computer vision techniques with deep learning networks.

Face Attribute Prediction with classification CNN

This paper considers the mid-level CNN features as an alternative to the high-level ones for attribute prediction, based on the observation that face attributes are different: some of them are locally oriented while others are globally defined.

Face attribute prediction using off-the-shelf CNN features

This paper combines with conventional face localization techniques, and uses off-the-shelf architectures trained for face recognition to build facial descriptors, demonstrating an efficient face attribute prediction approach and raising an important question: how to leverage the power of off- the- shelf CNN representations for novel tasks.

Face Attributes Recognition via Deep Multi-Task Cascade

A deep multi-task cascaded network for face attributes recognition is proposed, which is trained in an end-to-end way by the combination of attribute-associated region discovery and attribute prediction together.

Leveraging mid-level deep representations for predicting face attributes in the wild

The investigations reveal that the mid-level deep representations outperform the prediction accuracy achieved by the (fine-tuned) high-level abstractions and achieve state-of-the-art prediction performance on CelebA and LFWA datasets.

General-to-specific learning for facial attribute classification in the wild

Deep Learning Face Attributes for Detection and Alignment

This chapter aims to provide an in-depth presentation of recent progress and the current state-of-the-art approaches to solving some of the fundamental challenges in face attribute recognition, particularly from the angle of deep learning.

Transferring from face recognition to face attribute prediction through adaptive selection of off-the-shelf CNN representations

This paper addresses the problem of transferring CNNs pre-trained for face recognition to a face attribute prediction task by selecting face descriptors from off-the-shelf hierarchical CNN representations for recognizing different attributes through an adaptive representation selection.

A Deep Cascade Network for Unaligned Face Attribute Classification

A cascade network that simultaneously learns to localize face regions specific to attributes and performs attribute classification without alignment is proposed, achieving significantly better performance than state-of-the-art methods on unaligned CelebA dataset.

Deep Facial Attribute Detection in the Wild: From General to Specific

This work proposes a general-tospecific deep convolutional network architecture for predicting multiple attributes from a single image in the wild by model the interdependencies of local facial regions by joint learning of all the attributes.



Deep Attribute Networks

The potential of deep learning for attribute-based classification is demonstrated by showing comparable results with existing state-of-the-art results and does away with calculating low-level features which are maybe unreliable and computationally expensive.

DeepFace: Closing the Gap to Human-Level Performance in Face Verification

This work revisits both the alignment step and the representation step by employing explicit 3D face modeling in order to apply a piecewise affine transformation, and derive a face representation from a nine-layer deep neural network.

PANDA: Pose Aligned Networks for Deep Attribute Modeling

A new method which combines part-based models and deep learning by training pose-normalized CNNs for inferring human attributes from images of people under large variation of viewpoint, pose, appearance, articulation and occlusion is proposed.

Deep Learning Face Representation by Joint Identification-Verification

This paper shows that the face identification-verification task can be well solved with deep learning and using both face identification and verification signals as supervision, and the error rate has been significantly reduced.

A Deep Sum-Product Architecture for Robust Facial Attributes Analysis

This work has modeled region interdependencies with a discriminative decision tree, where each node consists of a detector and a classifier trained on a local region, which makes it more robust to occlusions and misdetection of face regions.

Hierarchical face parsing via deep learning

A novel face parser is proposed, which recasts segmentation of face components as a cross-modality data transformation problem, i.e., transforming an image patch to a label map.

Multi-View Perceptron: a Deep Model for Learning Face Identity and View Representations

This paper proposes a novel deep neural net, named multi-view perceptron (MVP), which can untangle the identity and view features, and in the meanwhile infer a full spectrum of multi- view images, given a single 2D face image.

Aggregate channel features for multi-view face detection

Following the learning pipelines in Viola-Jones framework, the multi-view face detector using aggregate channel features shows competitive performance against state-of-the-art algorithms on AFW and FDDB test-sets, while runs at 42 FPS on VGA images.

Deep Convolutional Network Cascade for Facial Point Detection

The proposed approach outperforms state-of-the-art methods in both detection accuracy and reliability and can avoid local minimum caused by ambiguity and data corruption in difficult image samples due to occlusions, large pose variations, and extreme lightings.

Attribute and simile classifiers for face verification

Two novel methods for face verification using binary classifiers trained to recognize the presence or absence of describable aspects of visual appearance and a new data set of real-world images of public figures acquired from the internet.