“Look, Ma – No Hands!” Hands-Free Cursor Control with Real-Time 3D Face Tracking

Abstract

This paper presents a real-time, non-invasive, vision system which performs hands-free cursor control by having users point their nose where they wish to place the cursor on a monitor screen. The vision system robustly tracks 3D face position and orientation in real time using a framework called Incremental Focus of Attention (IFA). IFA integrates tracking based on multiple cues (including color, intensity templates, and dark point features) which cooperate to track under adverse visual conditions. The pose recovered from tracking is then used to compute the intersection between the plane of the monitor screen and an imaginary ray extending forward from the user’s nose. Results show that naive users can position a cursor within a 1cm x 1cm square from a distance of 50cm from the monitor.

4 Figures and Tables

Statistics

01020'00'02'04'06'08'10'12'14'16
Citations per Year

99 Citations

Semantic Scholar estimates that this publication has 99 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@inproceedings{Toyama1998LookM, title={“Look, Ma – No Hands!” Hands-Free Cursor Control with Real-Time 3D Face Tracking}, author={Kentaro Toyama}, year={1998} }