Pupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction

@article{Kassner2014PupilAO,
  title={Pupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction},
  author={Moritz Kassner and William Patera and Andreas Bulling},
  journal={Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication},
  year={2014}
}
  • Moritz KassnerWilliam PateraA. Bulling
  • Published 30 April 2014
  • Computer Science
  • Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication
In this paper we present Pupil -- an accessible, affordable, and extensible open source platform for pervasive eye tracking and gaze-based interaction. Pupil comprises 1) a light-weight eye tracking headset, 2) an open source software framework for mobile eye tracking, as well as 3) a graphical user interface to playback and visualize video and gaze data. Pupil features high-resolution scene and eye cameras for monocular and binocular gaze estimation. The software and GUI are platform… 
View on ACM
arxiv.org
654 Citations
Highly Influential Citations
76
Background Citations
179
Methods Citations
288
Results Citations
9

Figures from this paper

654 Citations

EyeRecToo: Open-source Software for Real-time Pervasive Head-mounted Eye Tracking

EyeRecToo serves as a framework to quickly enable pervasive eye-tracking research and applications and offers multiple real-time state-ofthe-art pupil detection and gaze estimation methods, which can be easily replaced by user implemented algorithms if desired.

GazeVisual: A Practical Software Tool and Web Application for Performance Evaluation of Eye Tracking Systems

The concept and functionalities of a software tool developed for in depth performance evaluation of eye gaze estimation systems is presented and it is shown that the software can handle eye gaze datasets obtained from several different consumer grade eye trackers.

InvisibleEye: Mobile Eye Tracking Using Multiple Low-Resolution Cameras and Learning-Based Gaze Estimation

InvisibleEye is presented, a novel approach for mobile eye tracking that uses millimetre-size RGB cameras that can be fully embedded into normal glasses frames that achieves a top person-specific gaze estimation accuracy of 1.79° using four cameras with a resolution of only 5 × 5 pixels.

Gaze Estimation and Interaction in Real-World Environments

This thesis collects a large-scale gaze estimation dataset, MPIIGaze, and proposes GazeNet method, which uses convolutional neural networks for the first time for the gaze estimation task, and achieves significant improvement over previous state-of-the-art methods.

Improving Model-Based Mobile Gaze Tracking

An advanced user calibration procedure for estimating gaze vectors applicable with any model-based method and a Bayesian tracker for tracking any number of corneal reflections and the pupil center, applicable with both types of trackers are presented.

Neural 3D Gaze: 3D Pupil Localization and Gaze Tracking based on Anatomical Eye Model and Neural Refraction Correction

It is argued that accurate detection and localization of pupil in 3D space is a necessary intermediate step in model-based eye tracking, and a novel 3D pupil localization method with a deep learning-based corneal refraction correction is proposed.

Fixation detection for head-mounted eye tracking based on visual similarity of gaze targets

This work presents a novel fixation detection method for head-mounted eye trackers that outperforms commonly used velocity- and dispersion-based algorithms, which highlights its significant potential to analyse scene image information for eye movement detection.

EyeRec: An Open-source Data Acquisition Software for Head-mounted Eye-tracking

EyeRec is introduced, an open-source data acquisition software for head-mounted eye-tracking that offers real-time state-of-the-art pupil detection and gaze estimation, which can be easily replaced by user implemented algorithms if desired.

Prediction of gaze estimation error for error-aware gaze-based interfaces

This work introduces an error model that is able to predict the gaze estimation error and develops a model through a series of principled measurements of a state-of-the-art head-mounted eye tracker that covers major building blocks of mobile gaze estimation.

Facilitating Object Detection and Recognition through Eye Gaze

This work enables mobile gaze-aware applications by developing an open-source platform which supports mobile eye tracking based on the Pupil headset and a smartphone running Android OS and offers researchers and developers a rapid prototyping environment for gaze-enabled applications.
...

References

SHOWING 1-10 OF 38 REFERENCES

openEyes: a low-cost head-mounted eye-tracking solution

The openEyes system is developed, an open-hardware design for a digital eye tracker that can be built from low-cost off-the-shelf components, and a set of open-source software tools for digital image capture, manipulation, and analysis in eye-tracking applications.

Robust real-time pupil tracking in highly off-axis images

This work presents a novel, real-time dark-pupil tracking algorithm that uses a Haar-like feature detector to roughly estimate the pupil location, performs a k-means segmentation on the surrounding region to refine the pupil centre, and fits an ellipse to the pupil using a novel image-aware Random Sample Concensus (RANSAC)Ellipse fitting.

Limbus/pupil switching for wearable eye tracking under variable lighting conditions

A low-cost wearable eye tracker built from off-the-shelf components that automatically switching between tracking the pupil/iris boundary in bright light to tracking the iris/sclera boundary (limbus) in dim light is presented.

Do-It-Yourself Eye Tracker: Low-Cost Pupil-Based Eye Tracker for Computer Graphics Applications

This work shows that an eye tracker of a satisfactory precision can be built in the budget of 30 euros and test the accuracy of the eye tracker reveals that its precision is comparable to commercial video-based devices.

OMG!: a new robust, wearable and affordable open source mobile gaze tracker

A novel, robust, affordable and wearable, mobile gaze tracker that takes a model-based approach to tracking gaze and maps the calculated gaze on to a scene video using a 3D printed frame.

Building a lightweight eyetracking headgear

This paper encourages an "open-source" approach to eyetracking by providing practical tips on building a lightweight eyetracker from commercially available micro-lens cameras and other parts.

A head-mounted sensor-based eye tracking device: eye touch system

In this study, a new eye tracking system, namely Eye Touch, is introduced. Eye Touch is based on an eyeglasses-like apparatus on which IrDA sensitive sensors and IrDA light sources are mounted. Using…

Toward Mobile Eye-Based Human-Computer Interaction

Advances in mobile eye-tracking equipment and automated eye-movement analysis now allow for investigating eye movements during natural behavior and promise to bring eye-based interaction into people's everyday lives.

A cheap portable eye-tracker solution for common setups

This work analyzes the feasibility of a cheap eye-tracker where the hardware consists of a single webcam and a Raspberry Pi device and proposes several improvements to create a robust, real-time system which can work on a computer with 30Hz sampling rate.

Movements of the eye.

A SPECIAL CAMERA HAS BEEN DEVISED WHICH RECORDS THE MOVEMENTS OF THE EYE IN THE COURSE OF SUCH ACTIVITIES AS LOOKING AT PICTURES OR DRIVING AN AUTOMOBILE. IT REVEALS THAT THE EYE MOVES IN A SERIES OF…