Estimation of confidence based on eye gaze: an application to multiple-choice questions

Abstract

Multiple-choice questions are often used to assess the user's understanding. However, the system does not know if the user answered randomly, by chance, with confidence or without confidence. The user's confidence can be used as a feedback for teachers or smart interfaces that could understand that he is not sure of himself and then provide further assistance. We aim to create confidence aware interfaces such as pervasive display. As a first step, we propose an application in the context of multiple-choice question answering. By using an eye tracker, we analyze the reading and answering behavior of the user, extract some features and predict his confidence. We asked 11 participants to solve 80 multiple-choice questions about English understanding, and estimated whether they answered confidently or not. We obtained 90.1% average accuracy for this prediction.

DOI: 10.1145/3123024.3123138

2 Figures and Tables

Cite this paper

@inproceedings{Yamada2017EstimationOC, title={Estimation of confidence based on eye gaze: an application to multiple-choice questions}, author={Kento Yamada and Koichi Kise and Olivier Augereau}, booktitle={UbiComp/ISWC Adjunct}, year={2017} }