• Corpus ID: 17702225

An Efficient Algorithm for Motion Detection Based Facial Expression Recognition using Optical Flow

  title={An Efficient Algorithm for Motion Detection Based Facial Expression Recognition using Optical Flow},
  author={Ahmad Reza Naghsh-Nilchi and Mohammad Ali Roshanzamir},
  journal={World Academy of Science, Engineering and Technology, International Journal of Computer, Electrical, Automation, Control and Information Engineering},
  • A. Naghsh-Nilchi, M. Roshanzamir
  • Published 27 August 2008
  • Computer Science
  • World Academy of Science, Engineering and Technology, International Journal of Computer, Electrical, Automation, Control and Information Engineering
One of the popular methods for recognition of facial expressions such as happiness, sadness and surprise is based on deformation of facial features. Motion vectors which show these deformations can be specified by the optical flow. In this method, for detecting emotions, the resulted set of motion vectors are compared with standard deformation template that caused by facial expressions. In this paper, a new method is introduced to compute the quantity of likeness in order to make decision based… 

Figures and Tables from this paper

What happens in Face during a facial expression? Using data mining techniques to analyze facial expression motion vectors
Optical flow algorithm was used to extract deformation or motion vectors created in the face because of facial expressions, and these extracted motion vectors were used to be analyzed and recognized by employing motion vector features used as data.
Spontaneous Facial Expression Analysis Using Optical Flow Technique
Investigation of emotions manifested through facial expressions has valuable applications in predictive behavioural studies. A potential application may be to impart intelligence to surveillance
An optical flow computation algorithm which computes the frames of varying facial gestures, and integrating with synthesized image in a probabilistic environment has been proposed and Histogram Equalization technique has been used to overcome the effect of illuminations while capturing the input data using camera devices.
On all the evaluation parameters Bayesian regularized recurrent neural network (BRRNN) is found to be best suited for automatic facial expression recognition.
Horn Schunck Algorithm for Facial Expression Change Detection Classification
Based on the experiment conducted, the average value represented by every facial expression can be identified, and the values are significant for future research that focuses on facial expression classification.
Facial Action Units Recognition: A Comparative Study
This study presents an approach towards automatic AU recognition enabling recognition of an extensive palette of facial expressions and compares two spatial-temporal classification methods: Hidden Markov Models (HMM) and Dynamic Bayesian Networks (DBN).
Emotion recognition using facial and audio features
This work mainly focuses on automatic emotion recognition in a wild video sample using a combination of video features and audio features to produce better results for some particular class of emotions as compared to the baseline score in the case of wild emotion dataset.
Facial Expression Recognition using Neural Network –An Overview
This paper reviews various techniques of facial expression recognition systems using MATLAB (neural network) toolbox and classifies face detection and token matching.
Review on Strain Sensors for detection of Human Facial Expressions Recognition Systems
This review paper presents the development of stretchable strain sensors for human facial expression detection focusing mainly on the materials and fabrication strategies and provides fundamental structural design as well as challenges and opportunities in realizing stretchable strains sensor and their various potential applications.


Recognizing multiple persons' facial expressions using HMM based on automatic extraction of significant frames from image sequences
  • T. Otsuka, J. Ohya
  • Computer Science
    Proceedings of International Conference on Image Processing
  • 1997
Experiments show that a mixture density is effective because the recognition accuracy improves as the number of mixtures increases, and correctly recognizes a facial expression that continuously follows another one.
Feature-point tracking by optical flow discriminates subtle differences in facial expression
An optical flow based approach (feature point tracking) that is sensitive to subtle changes in facial expression is developed and implemented that demonstrated high concurrent validity with human coding using the Facial Action Coding System (FACS).
Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motion
This paper explores the use of local parametrized models of image motion for recovering and recognizing the non-rigid and articulated motion of human faces and shows how expressions can be recognized from the local parametric motions in the presence of significant head motion.
Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face.
  • J. N. Bassili
  • Psychology
    Journal of personality and social psychology
  • 1979
The results demonstrated that moving displays of happiness, sadness, fear, surprise, anger and disgust were recognized more accurately than static displays of the white spots at the apex of the expressions, indicating that facial motion, in the absence of information about the shape and position of facial features, is informative about these basic emotions.
Facial expression understanding in image sequences using dynamic and active visual information fusion
  • Yongmian Zhang, Q. Ji
  • Computer Science
    Proceedings Ninth IEEE International Conference on Computer Vision
  • 2003
This paper explores the use of multisensory information fusion technique with dynamic Bayesian networks (DBNs) for modeling and understanding the temporal behaviors of facial expressions in image sequences by integrating the DBNs with the facial action units (AUs) from psychological view.
Online facial expression recognition based on personalized galleries
  • Hai Hong, H. Neven, C. Malsburg
  • Computer Science
    Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition
  • 1998
An online facial expression recognition system based on personalized galleries is presented. This system is built on the framework of the PersonSpotter system, which is able to track and detect the
Classifying Facial Action
Three different approaches to classifying the facial actions in these images are compared: Holistic spatial analysis based on principal components of graylevel images; explicit measurement of local image features such as wrinkles; and template matching with motion flow fields.
Face Recognition Using Active Appearance Models
This paper demonstrates the use of the AAM's efficient iterative matching scheme for image interpretation, which allows identity information to be decoupled from other variation, allowing evidence of identity to be integrated over a sequence.
A phase-based approach to the estimation of the optical flow field using spatial filtering
This work introduces a new technique for estimating the optical flow field, starting from image sequences, and tracks contours of constant phase over time, since these are more robust to variations in lighting conditions and deviations from pure translation than contouring of constant amplitude.
Framerate pupil detector and gaze tracker
A robust, frame-rate pupil detector technique, based on an active illumination scheme, used for gaze estimation, which uses the vector computed from the pupil center to the center of the corneal glints generated from light sources to estimate the gaze position.