Real-time detection of nodding and head-shaking by directly detecting and tracking the "between-eyes"

@article{Kawato2000RealtimeDO,
  title={Real-time detection of nodding and head-shaking by directly detecting and tracking the "between-eyes"},
  author={Shinjiro Kawato and Jun Ohya},
  journal={Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580)},
  year={2000},
  pages={40-45}
}
  • S. Kawato, J. Ohya
  • Published 26 March 2000
  • Computer Science
  • Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580)
Among head gestures, nodding and head-shaking are very common and used often. [] Key Method Combining with the circle-frequency filtering and the template, the tracking is done not by searching around but by selecting candidates using the template; the template is then updated. Due to this special tracking algorithm, the system can track the "between-eyes" stably and accurately. It runs at 13 frames/s rate without special hardware. By analyzing the movement of the point, we can detect nodding and head…

Figures and Tables from this paper

Real Time Head Nod and Shake Detection Using HMMs
TLDR
The proposed system is composed of face detection, eye detection and head nod and head shake detection, which uses motion segmentation algorithm that makes use of differencing to detect moving people's faces.
A real-time head nod and shake detector using HMMs
Detection and tracking of eyes for gaze-camera control
Two-step approach for real-time eye tracking with a new filtering technique
  • S. Kawato, J. Ohya
  • Computer Science
    Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0
  • 2000
TLDR
A two-step approach for eye tracking in video streams where detecting a point between the eyes is easier and more stable than detecting the eyes directly and the system can track the eyes robustly.
Development of head detection and tracking systems for visual surveillance
TLDR
The novelty of this paper is derived from differences in real-time input images, preprocessing to remove noises (morphological operators and so on), detecting edge lines and restoration, finding the face area, and cutting the head candidate.
A real-time head nod and shake detector
TLDR
A vision-based system that detects head nods and head shakes in real time and can act as a useful and basic interface to a machine is described.
Real-time Detection of Between-the-Eyes with a Circle Frequency Filter
TLDR
A method to extract the center point between the eyes or Between-the-Eyes in real time, which can be a good clue in detecting other face feature points and also face rotation angles in the image plane at the candidate points.
A robust human-eye tracking method in video sequences
TLDR
An accurate tracking method of the human eyes in video sequence without any learning schemes, templates, and geometric relations of the other facial features is proposed.
In the Eye of the Beholder: A Survey of Models for Eyes and Gaze
  • D. Hansen, Q. Ji
  • Computer Science
    IEEE Transactions on Pattern Analysis and Machine Intelligence
  • 2010
TLDR
This review shows that, despite their apparent simplicity, the development of a general eye detection technique involves addressing many challenges, requires further theoretical developments, and is consequently of interest to many other domains problems in computer vision and beyond.
Head nod and shake recognition based on multi-view model and hidden Markov model
TLDR
A novel approach to recognize the nod and shake in the interactive computer environment is presented, where head poses are detected by multi-view model (MVM) and hidden Markov model (HMM) are used as head gesture statistic inference model for gesture recognition.
...
...

References

SHOWING 1-10 OF 13 REFERENCES
Tracking Eyes and Monitoring Eye Gaze
TLDR
A non-intrusive eye tracker which can detect and track a user's eyes in real time as soon as the face appears in the view of the camera without special lighting or any marks on the user's face is presented.
Real-time visual recognition of facial gestures for human-computer interaction
  • A. Zelinsky, J. Heinzmann
  • Computer Science, Psychology
    Proceedings of the Second International Conference on Automatic Face and Gesture Recognition
  • 1996
TLDR
This work has implemented an interface that tracks a person's facial features in real time (30 Hz) and can recognise a large set of gestures ranging from "yes", "no" and "may be" to detecting winks, blinks and sleeping.
Real-Time Face and Facial Feature Tracking and Applications
TLDR
It is revealed that human skincolor can be used as a major feature for tracking human faces and an adaptive stochastic model has been developed to characterize the skin-color distributions.
A real-time face tracker
  • Jie Yang, A. Waibel
  • Computer Science
    Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96
  • 1996
TLDR
The authors present a real-time face tracker that can track a person's face while the person moves freely in a room and can be applied to teleconferencing and many HCI applications including lip reading and gaze tracking.
3-D facial pose and gaze point estimation using a robust real-time tracking paradigm
  • J. Heinzmann, A. Zelinsky
  • Computer Science
    Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition
  • 1998
TLDR
This paper proposes a system capable of tracking a face and estimating the 3-D pose and the gaze point all in a real-time video stream of the head by using a 3D model together with multiple triplet triangulation of feature positions assuming an affine projection.
3D head pose estimation without feature tracking
TLDR
A robust approach to estimate the 3D pose of human heads in a single image using an efficient algorithm based on a perceptually uniform color system and fuzzy theory to extract the skin region and hair region, which are then used to detect faces in images.
Headreader: Realtime motion detection of human head from image sequence
TLDR
A simple but very fast algorithm is used which exploits the contrast of hair and face to recognize face orientation and extracts the head and face area and then estimates the head motion parameters from the change in position of each area centroids.
Robust face feature analysis for automatic speechreading and character animation
  • E. Petajan, H. Graf
  • Computer Science
    Proceedings of the Second International Conference on Automatic Face and Gesture Recognition
  • 1996
TLDR
A face feature acquisition system with robust performance in the presence of extreme lighting variations and moderate variations in pose, which can be used as the basis for visual speech features in an automatic speechreading system.
Automatic detection of human faces in natural scene images by use of a skin color model and of invariant moments
TLDR
Preliminary results show the efficiency of the combination of color segmentation and of invariant moments in detecting faces with a large variety of poses and against relatively complex backgrounds.
Face recognition using temporal image sequence
TLDR
A face recognition method using image sequence that essentially form a subspace with the image sequence and applies the Mutual Subspace Method in which the similarity is defined by the angle between the subspace of input and those of references.
...
...