Real-time mimicking of estonian speaker's mouth movements on a 3D avatar using Kinect 2

@article{Lsi2015RealtimeMO,
  title={Real-time mimicking of estonian speaker's mouth movements on a 3D avatar using Kinect 2},
  author={Iiris L{\"u}si and Gholamreza Anbarjafari and Einar Meister},
  journal={2015 International Conference on Information and Communication Technology Convergence (ICTC)},
  year={2015},
  pages={141-143}
}
In this paper an algorithm for the real-time imitation of lips movements of an Estonian speaker on a 3D avatar is proposed. This research is focused on obtaining the RGB and depth information from a Kinect 2 camera, processing it and moving the avatar accordingly. For the more stable extraction of information about lip shape and movement, cosine function is used. The depth info helps to determine the closest speaker and stabilize the movement of avatar and tracking of lips. 

From This Paper

Topics from this paper.

Citations

Publications citing this paper.
Showing 1-2 of 2 extracted citations

Computer Vision – ECCV 2016 Workshops

Lecture Notes in Computer Science • 2016
View 12 Excerpts
Highly Influenced

References

Publications referenced by this paper.
Showing 1-10 of 15 references

Facial Expression Detection Techniques: Based on Viola and Jones Algorithm and Principal Component Analysis

2015 Fifth International Conference on Advanced Computing & Communication Technologies • 2015

Learning the Deep Features for Eye Detection in Uncontrolled Conditions

2014 22nd International Conference on Pattern Recognition • 2014
View 1 Excerpt

Kalman Filter for Robot Vision: A Survey

IEEE Transactions on Industrial Electronics • 2012
View 1 Excerpt

Real-time facial feature detection using conditional regression forests

2012 IEEE Conference on Computer Vision and Pattern Recognition • 2012
View 1 Excerpt

Lip Detection and Tracking Using Variance Based Haar-Like Features and Kalman filter

2010 Fifth International Conference on Frontier of Computer Science and Technology • 2010
View 1 Excerpt

Similar Papers

Loading similar papers…