Motion regularization for model-based head tracking


This paper describes a method for the robust tracking of rigid head motion from video. This method uses a 3D ellipsoidal model of the head and interprets the optical flow in terms of the possible rigid motions of the model. This method is robust to large angular and translational motions of the head and is not subject to the singularities of a 2D model. The method has been successfully applied to heads with a variety of shapes, hair styles, etc. This method also has the advantage of accurately capturing the 3D motion parameters of the head. This accuracy is shown through comparison with a ground truth synthetic sequence (a rendered 3D animation of a model head). In addition, the ellipsoidal model is robust to small variations in the initial fit, enabling the automationof the model initialization. Lastly, due to its consideration of the entire 3D aspect of the head, the tracking is very stable over a large number of frames. This robustness extends even to sequences with very low frame rates and noisy camera images. Categories: Facial Expressions, Expression Recognition, Face Processing, Facial Analysis, Systems and Applications, Motion Analysis, Pattern Analysis, Vision-based HCI.

DOI: 10.1109/ICPR.1996.547019

Extracted Key Phrases

4 Figures and Tables


Citations per Year

279 Citations

Semantic Scholar estimates that this publication has 279 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@inproceedings{Basu1996MotionRF, title={Motion regularization for model-based head tracking}, author={Sumit Basu and Irfan A. Essa and Alex Pentland}, booktitle={ICPR}, year={1996} }