Coding Facial Expressions with Gabor Wavelets (IVC Special Issue)

@article{Lyons2020CodingFE,
  title={Coding Facial Expressions with Gabor Wavelets (IVC Special Issue)},
  author={Michael J. Lyons and Miyuki G. Kamachi and Jiro Gyoba},
  journal={ArXiv},
  year={2020},
  volume={abs/2009.05938}
}
We present a method for extracting information about facial expressions from digital images. The method codes facial expression images using a multi-orientation, multi-resolution set of Gabor filters that are topographically ordered and approximately aligned with the face. A similarity space derived from this code is compared with one derived from semantic ratings of the images by human observers. Interestingly the low-dimensional structure of the image-derived similarity space shares… 

Figures and Tables from this paper

Fusion of multi representation and multi descriptors for facial expression recognition
TLDR
The proposed fusion of multi representations and multi descriptors achieves better or competitive performance compared with the state-of-the-art methods.
Facial Emotion Recognition Focused on Descriptive Region Segmentation
TLDR
This project explores the potential of real time FER based on the use of local regions of interest combined with a machine learning approach and validated the hypothesis a focus on smaller informative regions performs just as well as the entire image.
Facial Expression Recognition Using Pose-Guided Face Alignment and Discriminative Features Based on Deep Learning
TLDR
A novel deep model is proposed to improve the classification accuracy of facial expressions and can comparable performance in a variety of tasks.
Detection of Genuine and Posed Facial Expressions of Emotion: Databases and Methods
TLDR
A general review of the relevant research, including several spontaneous vs. posed (SVP) facial expression databases and various computer vision based detection methods, is presented.
Domain Adaptation for Facial Expression Classifier via Domain Discrimination and Gradient Reversal
TLDR
A new architecture for the task of FER is proposed and the impact of domain discrimination loss regularization on the learning process is examined, as well as important aspects of the considered domain adaptation approach integration are traced.
Artificial Intelligence-Based Human–Computer Interaction Technology Applied in Consumer Behavior Analysis and Experiential Education
In the course of consumer behavior, it is necessary to study the relationship between the characteristics of psychological activities and the laws of behavior when consumers acquire and use products
"Excavating AI" Re-excavated: Debunking a Fallacious Account of the JAFFE Dataset
TLDR
The present article recounts the creation of the JAFFE dataset and unravels each of Crawford and Paglen’s fallacious statements.
Clustering by Constructing Hyper-Planes
TLDR
An algorithm which can find the cluster number automatically is presented, which firstly constructs hyper-planes based on the marginal of sample points, then an adjacent relationship between data points is defined and connective components are derived.

References

SHOWING 1-10 OF 27 REFERENCES
Coding facial expressions with Gabor wavelets
TLDR
The results show that it is possible to construct a facial expression classifier with Gabor coding of the facial images as the input stage and the Gabor representation shows a significant degree of psychological plausibility, a design feature which may be important for human-computer interfaces.
A linked aggregate code for processing faces
A model of face representation, inspired by known biology of the visual system, is compared to experimental data on the perception of facial similarity. The face representation model uses aggregate
Classifying Facial Action
TLDR
Three different approaches to classifying the facial actions in these images are compared: Holistic spatial analysis based on principal components of graylevel images; explicit measurement of local image features such as wrinkles; and template matching with motion flow fields.
Relativity in the Perception of Emotion in Facial Expressions
SUMMARY The same facial expression will be seen as expressing different types and degrees of emotion, depending on what other faces are seen. A relatively neutral face seems sad when presented
Automatic Classification of Single Facial Images
TLDR
This work proposes a method for automatically classifying facial images based on labeled elastic graph matching, a 2D Gabor wavelet representation, and linear discriminant analysis, and a visual interpretation of the discriminant vectors.
Identifying Emotion in Static Face Images
TLDR
This work uses combinations of feedforward networks trained to recognize emotions in face images to achieve excellent generalization on novel faces, suggesting that the actual representational scheme used by the brain to identify emotions may consist of face features rather than the entire face.
An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex.
TLDR
It seems that an optimal strategy has evolved for sampling images simultaneously in the 2D spatial and spatial frequency domains and the Gabor function provides a useful and reasonably accurate description of most spatial aspects of simple receptive fields.
Distortion Invariant Object Recognition in the Dynamic Link Architecture
TLDR
An object recognition system based on the dynamic link architecture, an extension to classical artificial neural networks (ANNs), is presented and the implementation on a transputer network achieved recognition of human faces and office objects from gray-level camera images.
Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters.
  • J. Daugman
  • Physics
    Journal of the Optical Society of America. A, Optics and image science
  • 1985
TLDR
Evidence is presented that the 2D receptive-field profiles of simple cells in mammalian visual cortex are well described by members of this optimal 2D filter family, and thus such visual neurons could be said to optimize the general uncertainty relations for joint 2D-spatial-2D-spectral information resolution.
Recognizing Human Facial Expressions From Long Image Sequences Using Optical Flow
Low-oil-content, fully lubricated leather is produced by (1) treatment of leather with water emulsions of mixtures of alkanolamine soaps, oils, surfactants having HLB values between 2 and 6, and
...
...