Autopilot, Mind Wandering, and the Out of the Loop Performance Problem

  title={Autopilot, Mind Wandering, and the Out of the Loop Performance Problem},
  author={Jonas Gouraud and Arnaud Delorme and Bruno Berberian},
  journal={Frontiers in Neuroscience},
To satisfy the increasing demand for safer critical systems, engineers have integrated higher levels of automation, such as glass cockpits in aircraft, power plants, and driverless cars. These guiding principles relegate the operator to a monitoring role, increasing risks for humans to lack system understanding. The out of the loop performance problem arises when operators suffer from complacency and vigilance decrement; consequently, when automation does not behave as expected, understanding… 
Out of the Loop, in Your Bubble: Mind Wandering Is Independent From Automation Reliability, but Influences Task Engagement
Mental demand ratings and pupil diameter were lower during both task-related and task-unrelated MW, compared to those during the focus attentional state, shows that perceptual decoupling also affects the engagement of operators in automated environments, which may dramatically lower their ability to supervise automation efficiently.
Improving Human Performance Using Mixed Granularity of Control in Multi-Human Multi-Robot Interaction
  • Jayam Patel, Carlo Pinciroli
  • Computer Science
    2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)
  • 2020
Through a user study involving 28 human operators and 8 real robots, this paper study how the concept of mixed granularity in multi-human multi-robot interaction affects user engagement, awareness, and trust while balancing the workload between multiple operators.
Engaging the human operator: a review of the theoretical support for the vigilance decrement and a discussion of practical applications
Abstract Vigilance, or the ability to sustain attention for extended periods of time, has been of interest to the human factors and ergonomics community for 70 years. During this time, several
Busy and confused? High risk of missed alerts in the cockpit: an electrophysiological study
The results showed that both mental and auditory loads affected tone detection performance, and increased mental load, auditory load, and miss rate, were all associated with disrupted brain response to the target tone as showed by reductions of the P3b amplitude.
Degraded States of Engagement in Air Traffic Control
Safety studies have identified attention as a recurring cause of incidents and accidents in air traffic control. However, little is known of the precise attentional states that lead to degraded ATC
Mind-wandering while driving: The impact of fatigue, task length, and sustained attention abilities


The Out-of-the-Loop Performance Problem and Level of Control in Automation
This work studied the automation of a navigation task using an expert system and demonstrated that low SA corresponded with out-of-the-loop performance decrements in decision time following a failure of the expert system.
Thoughts in Flight
Although cockpit automation may provide pilots with more time to think, it may encourage pilots to reinvest only some of this mental free time in thinking flight-related thoughts.
Design of Automation for Telerobots and the Effect on Performance, Operator Situation Awareness, and Subjective Workload
Improvements in human-machine system performance at higher LOAs along with lower operator subjective workload are demonstrated, however, under the same conditions, operator SA was reduced for certain types of system problems and reaction time to, and performance during, automation failures was substantially lower.
How in the World Did We Ever Get into That Mode? Mode Error and Awareness in Supervisory Control
The result is an expanded view of mode error that takes into account the new demands imposed by more automated systems.
Automation-induced complacency for monitoring highly reliable systems: the role of task complexity, system experience, and operator trust
The increase in quantity and complexity of advanced automated systems has generated new concerns surrounding automation-induced complacency, or the difficulties operators have monitoring the status
“From Tool to Agent”: The Evolution of (Cockpit) Automation and Its Impact on Human-Machine Coordination
Pilots were more likely to fail to observe and interfere with uncommanded and undesired automation and aircraft behavior, illustrating the need for improved communicative abilities in autonomous and powerful systems to enable them to actively support the coordination between human and machine.
Using Variable-Rate Alerting to Counter Boredom in Human Supervisory Control
A low task load, long duration experiment was conducted to evaluate the impact of cyclical attention switching strategies on operator performance in supervisory domains. The impetus for such a study
Automation Technology and Sense of Control: A Window on Human Agency
This work demonstrates that Intentional Binding also occurs in complex control situations, using an aircraft supervision task with different autopilot settings, and indicates a strong relation between measures of IB and different levels of system automation.
Monitoring an Automated System for a Single Failure: Vigilance and Task Complexity Effects
The present study examined the effects of task complexity and time on task on the monitoring of a single automation failure during performance of a complex flight simulation task involving tracking,
Performance Consequences of Automation-Induced 'Complacency'
The effect of variations in the reliability of an automated monitoring system on human operator detection of automation failures was examined in two experiments, providing the first empirical evidence of the performance consequences of these changes.