Multi-User Egocentric Online System for Unsupervised Assistance on Object Usage


We present an online fully unsupervised approach for automatically extracting video guides of how objects are used from wearable gaze trackers worn by multiple users. Given egocentric video and eye gaze from multiple users performing tasks, the system discovers task-relevant objects and automatically extracts guidance videos on how these objects have been used. In the assistive mode, the paper proposes a method for selecting a suitable video guide to be displayed to a novice user indicating how to use an object, purely triggered by the user’s gaze. The approach is tested on a variety of daily tasks ranging from opening a door, to preparing coffee and operating a gym machine.

DOI: 10.1007/978-3-319-16199-0_34

Extracted Key Phrases

9 Figures and Tables

Cite this paper

@inproceedings{Damen2014MultiUserEO, title={Multi-User Egocentric Online System for Unsupervised Assistance on Object Usage}, author={Dima Damen and Osian Haines and Teesid Leelasawassuk and Andrew Calway and Walterio W. Mayol-Cuevas}, booktitle={ECCV Workshops}, year={2014} }