Robust Multimodal Cognitive Load Measurement

  title={Robust Multimodal Cognitive Load Measurement},
  author={Fang Chen and Jianlong Zhou and Yang Wang and Kun Yu and Syed Arshad and Ahmad Khawaji and Dan Conway},
  booktitle={Human–Computer Interaction Series},
This book explores robust multimodal cognitive load measurement with physiological and behavioural modalities, which involve the eye, Galvanic Skin Response, speech, language, pen input, mouse movement and multimodality fusions. Factors including stress, trust, and environmental factors such as illumination are discussed regarding their implications for cognitive load measurement. Furthermore, dynamic workload adjustment and real-time cognitive load measurement with data streaming are presented… 

Combining physiological data and subjective measurements to investigate cognitive load during complex learning

Cognitive load theory is one of the most influential theoretical explanations of cognitive processing during learning. Despite its success, attempts to assess cognitive load during learning have

Use of Eye-Tracking Technology to Investigate Cognitive Load Theory

This current study will show how several eye-tracking based parameters are related to the three kinds of load by having explicit manipulation of the three loads independently.

Effective Assessment of Cognitive Load in Real-World Scenarios using Wrist-worn Sensor Data

This study proposes an approach for classification of cognitive load based on physiological signals collected through wearable devices and yields classification accuracy of 69% for binary classification which is better than the current state-of-the-art.

Multimodal Fusion for Cognitive Load Measurement in an Adaptive Virtual Reality Driving Task for Autism Intervention

A virtual reality driving system was designed to improve driving skills in individuals with autism spectrum disorder (ASD), and multiple classification methods and features from different modalities were used to evaluate participant’s cognitive load.

A framework to estimate cognitive load using physiological data

It is found that, while mean pupil diameter change for both right and left eye were the most prominent features, blinking rate also made a moderately important contribution to this highly accurate prediction of low, medium and high cognitive load.

Multichannel data for understanding cognitive affordances during complex problem solving

Results indicate that cognitive load influences strategy use, and subjective measurements of students' cognitive load combined with physiological data containing galvanic skin response and skin temperature reveal that GSR might be related to mental effort.

Pattern analysis of physiological data for the assessment of mental workload

  • D. Bläsing
  • Psychology
    Zeitschrift für Arbeitswissenschaft
  • 2022
Measuring mental workload at the workplace using (psycho-) physiological measurement techniques seems desirable but is difficult to implement. Conventional analysis techniques are designed to cover

Measuring Cognitive Load using Eye Tracking Technology in Visual Computing

It is argued that eye tracking should be considered as a valuable instrument to analyze cognitive processes in visual computing and suggest future research directions to tackle outstanding issues.

Cheetah Experimental Platform Web 1.0: Cleaning Pupillary Data

CEP-Web, an open source platform to providing state of the art data processing routines for cleaning pupillary data combined with a graphical user interface, enabling the management of studies and subjects and support for Task-Evoked Pupillary Response studies.



Galvanic skin response (GSR) as an index of cognitive load

This interesting result verifies that GSR can be used to serve as an objective indicator of user cognitive load level in real time, with a very fine granularity.

Trust and cognitive load in the text-chat environment: the role of mouse movement

To establish trust in the chat environment, it is better to communicate under a low cognitive load, and the ability of designed systems to measure cognitive load via tracking mouse events for the purpose of providing assistance to communicators is shown.

Eye activity as a measure of human mental effort in HCI

Research into eight eye activity based features, spanning eye blink, pupillary response and eye movement information, for real time mental effort measurement shows an initial step towards a real-time cognitive load measurement system in human-computer interaction.

Estimating cognitive load using remote eye tracking in a driving simulator

The physiological and performance measures show high correspondence suggesting that remote eye tracking might provide reliable driver cognitive load estimation, especially in simulators, and introduced a new pupillometric cognitive load measure that shows promise in tracking cognitive load changes on time scales of several seconds.

Using language complexity to measure cognitive load for adaptive interaction design

A novel speech content analysis approach for measuring users' cognitive load, based on their language and dialogue complexity, is proposed, which has analysed the transcribed speech of operators working in computerized incident control rooms and involved in highly complex bushfire management tasks in Australia.

Pupil Dilation as an Indicator of Cognitive Workload in Human-Computer Interaction

A neural-network based calibration interface for eye-tracking systems is developed and implemented, which is capable of almost completely eliminating the geometry-based distortion of pupil-size data for any human subject.

The Index of Cognitive Activity: measuring cognitive workload

  • S. Marshall
  • Computer Science, Psychology
    Proceedings of the IEEE 7th Conference on Human Factors and Power Plants
  • 2002
The Index of Cognitive Activity (ICA) provides an important estimate of the levels of cognitive effort of the user, based on changes in pupil dilation that occur as a user interacts with a visual display.

Information presentation based on estimation of human multimodal cognitive load

  • F. WadaM. IwataS. Tano
  • Computer Science
    Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569)
  • 2001
The results suggest that the combination of information presentation format influences the subjects' ability to recognize them and that there is a possibility that each of the three hypotheses related to cognitive load is valid.

Analysis of Collaborative Communication for Linguistic Cues of Cognitive Load

Encouraging evidence is provided for the use of linguistic and grammatical analysis for measuring users’ cognitive load and some novel features as cognitive load indices are proposed.

Indexing cognitive workload based on pupillary response under luminance and emotional changes

Machine learning based feature selection and classification techniques are proposed to robustly index cognitive workload based on pupillary response even with the influence of noisy factors unrelated to workload.