Measuring Cognitive Workload Using Multimodal Sensors

  title={Measuring Cognitive Workload Using Multimodal Sensors},
  author={Niraj Hirachan and Anit Mathews and Julio Romero and Raul Fernandez Rojas},
  journal={2022 44th Annual International Conference of the IEEE Engineering in Medicine \& Biology Society (EMBC)},
  • Niraj HirachanAnit Mathews R. Rojas
  • Published 5 May 2022
  • Psychology
  • 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)
This study aims to identify a set of indicators to estimate cognitive workload using a multimodal sensing approach and machine learning. A set of three cognitive tests were conducted to induce cognitive workload in twelve participants at two levels of task difficulty (Easy and Hard). Four sensors were used to measure the participants' physiological change, including, Electrocardiogram (ECG), electrodermal activity (EDA), respiration (RESP), and blood oxygen saturation (SpO2). To understand the… 

Figures and Tables from this paper



Measurement and identification of mental workload during simulated computer tasks with multimodal methods and machine learning

The classification of mental workload using combined indices as inputs showed that classification models combining physiological signals and task performance can reach satisfying accuracy, and showed that ECG and EDA signals have good discriminating power for mental workload detection.

Estimating changes in a cognitive performance using heart rate variability

A low-invasive framework for estimating changes in a cognitive performance using heart rate variability has the potential to help managerial personnel in making performance change reports for their workers, suggesting reasons for changes in the performance, and urging them to change their working styles using HRV.

Measuring mental workload using physiological measures: A systematic review.

GSR and Blink Features for Cognitive Load Classification

Results show that the studied features of blink and GSR can reasonably discriminate workload levels and combining features of the two modalities improves the accuracy of cognitive load classification.

A Machine Learning Approach for the Identification of a Biomarker of Human Pain using fNIRS

Functional near-infrared spectroscopy (fNIRS) and machine learning are proposed for the identification of a possible biomarker of pain to improve pain management, reduce risk factors, and contribute to a more objective, valid, and reliable diagnosis.

Measuring mental workload with the NASA-TLX needs to examine each dimension rather than relying on the global score: an example with driving

Results showed that, in complex situation, mental, temporal and physical demand (load dimensions) increased, and that novice drivers presented high physical demand when subjective tension was low on performance, appearing essential to distinguish the different components of mental workload used in the NASA-TLX questionnaire.

Cluster-Based Analysis for Personalized Stress Evaluation Using Physiological Signals

A novel cluster-based analysis method to measure perceived stress using physiological signals, which accounts for the intersubject differences, and shows a significant improvement in evaluation accuracy as compared to traditional methods without clustering.

Electroencephalographic Workload Indicators During Teleoperation of an Unmanned Aerial Vehicle Shepherding a Swarm of Unmanned Ground Vehicles in Contested Environments

A set of features represents EEG indicators for the objective assessment of cognitive workload across subjects that could be used for augmented intelligence in human-autonomy teaming scenarios, and form the basis for the work on designing a closed-loop augmented cognition system for human-swarm teaming.

Human Activity Recognition With Accelerometer and Gyroscope: A Data Fusion Approach

Kalman filter appear to be the more efficient method, since it exhibited both good accuracy and short processing time and properties that play a large role in real-time applications using wearable devices.

NASA-TLX Assessment of Surgeon Workload Variation Across Specialties.

Workload was measured across surgical specialties using surveys to identify potential predictors of high workload for future performance improvement and to identify patient and surgical variables associated with unexpected difficulty and high workload.