A Comparative Analysis of Sagat and Sart for Evaluations of Situation Awareness

@article{Endsley1998ACA,
  title={A Comparative Analysis of Sagat and Sart for Evaluations of Situation Awareness},
  author={Mica R. Endsley and Stephen J. Selcon and Thomas D. Hardiman and Darryl G. Croft},
  journal={Proceedings of the Human Factors and Ergonomics Society Annual Meeting},
  year={1998},
  volume={42},
  pages={82 - 86}
}
  • M. Endsley, S. Selcon, D. Croft
  • Published 1 October 1998
  • Psychology
  • Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Situation awareness (SA) has become an important criterion for systems evaluation efforts. Several measures of SA have been developed, the most widely used among them being the Situation Awareness Global Assessment Technique (SAGAT) and the Situational Awareness Rating Technique (SART). SAGAT provides an objective measure of SA based on queries during freezes in a simulation. SART provides a subjective rating of SA by operators. This paper presents a direct comparison of the two measures which… 

Figures from this paper

Comparison of Two Situation Awareness Metrics: SAGAT and SA-SWORD
TLDR
A study that compared SAGAT and SA-SWORD in a simulated low-level ingress scenario found that the type of SA metric used did not affect performance measures collected.
Quantitative Analysis of Situation Awareness (QASA): modelling and measuring situation awareness using signal detection theory
TLDR
A technique based around signal detection theory has been developed from this model that provides separate measures of actual SA (ASA) and perceived SA (PSA), together with a feature unique to QASA, a measure of bias (information acceptance).
Measuring Situation Awareness during Command and Control Activity : A Comparison of Measures Study
The level of Situation Awareness (SA) that systems and devices provide to individuals and teams is a critical factor that needs assessing throughout the design process. There are various methods
A Systematic Review and Meta-Analysis of Direct Objective Measures of Situation Awareness: A Comparison of SAGAT and SPAM
TLDR
A meta-analysis of 243 studies was conducted and SAGAT was found to be a highly sensitive, reliable, and predictive measure of SA that is useful across a wide variety of domains and experimental settings.
Subjective Evaluation of Seafarers� Situational Awareness on Collision Avoidance
Objectives: This study aims to investigate the situational awareness capabilities of seafarers which is the weakness of the safety management system studies conducted under the human element
Physiological Measurements of Situation Awareness: A Systematic Review.
TLDR
This review provides researchers and practitioners a summary of observed methods to indirectly assess SA with sensors and highlights research gaps to be addressed in future work.
A safety-critical decision support system evaluation using situation awareness and workload measures
The role of metacognition in the relationship between objective and subjective measures of situation awareness
The present paper is concerned with the relationship between subjective and objective measures of situation awareness (SA) within the context of a realistic command and control (C2) scenario. A 2-day
...
...

References

SHOWING 1-10 OF 25 REFERENCES
Predictive Utility of an Objective Measure of Situation Awareness
Situation awareness (SA) can generally be defined as the pilot's mental model of the world around him. The ability of the pilot to maintain situation awareness has been recognized in the pilot
Workload or Situational Awareness?: TLX vs. SART for Aerospace Systems Design Evaluation
Both workload and situational awareness (SA) have been recognised as important considerations in aerospace system design evaluation. This paper considers the use of subjective techniques for the
Measurement of Situation Awareness in Dynamic Systems
TLDR
Two studies are presented that investigate questions of validity and intrusiveness regarding a query-based technique that requires that a simulation of the operational tasks be momentarily interrupted in order to query operators on their situation awareness.
Design and Evaluation for Situation Awareness Enhancement
TLDR
A discussion of the SA construct, important considerations facing designers of aircraft systems, and current research in the area of SA measurement are presented.
Performance Consequences of Automation-Induced 'Complacency'
TLDR
The effect of variations in the reliability of an automated monitoring system on human operator detection of automation failures was examined in two experiments, providing the first empirical evidence of the performance consequences of these changes.
Telling more than we can know: Verbal reports on mental processes.
Evidence is reviewed which suggests that there may be little or no direct introspective access to higher order cognitive processes. Subjects are sometimes (a) unaware of the existence of a stimulus
FORMAL MODELS VS. HUMAN SITUATIONAL UNDERSTANDING: INHERENT LIMITATIONS ON THE MODELING OF BUSINESS EXPERTISE
Possible limitations on the successful formal modeling of human expertise can only be identified if the evolving thought processes involved in acquiring expertise are understood. This paper presents
Human Factors Society
Evaluation of the situational awareness rating technique (SART) as a tool for aircrew systems design
  • 1990
The validation of an explanatory tool for data-fused displays for high-technology aircraft
  • Proceedings of the Head Mounted
  • 1996
...
...