Measuring Situation Awareness in complex systems: Comparison of measures study

被引:229
作者
Salmon, Paul M. [1 ]
Stanton, Neville A. [1 ]
Walker, Guy H. [1 ]
Jenkins, Daniel [1 ]
Ladva, Darshna [1 ]
Rafferty, Laura [1 ]
Young, Mark [1 ]
机构
[1] Brunel Univ, Human Factors Integrat Def Technol Ctr HFI DTC, BIT Lab, Sch Engn & Design, Uxbridge UB8 3PH, Middx, England
关键词
Situation Awareness; Situation Awareness measurement; Command and control;
D O I
10.1016/j.ergon.2008.10.010
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Assessing operator situation awareness is a key component of sociotechnical system design and evaluation. This article describes a study that was undertaken in order to compare two different situation awareness measures (a freeze probe recall approach and a post trial subjective rating approach) when used to assess participant situation awareness during a military planning task. The results indicate that only the participant situation awareness scores derived via the freeze probe recall method produced a statistically significant correlation with performance on the planning task and also that there was no significant correlation between the two methods, which suggests that they were measuring different aspects of participant situation awareness during the trials. In conclusion, the findings, whilst raising doubts over the validity of the post trial subjective rating approach, offer validation evidence for the use of freeze probe recall approaches to measure situation awareness during simulated tasks. The findings are subsequently discussed with regard to their wider implications for the future measurement of situation awareness in complex collaborative systems. Relevance to industry: Situation Awareness is a critical commodity for teams working in industrial systems. Accordingly, designers and analysts require reliable and valid methods for assessing the impact of new systems, interfaces, training programs and procedures on the level of situation awareness held by operators. This article presents a review and comparison of situation awareness measurement approaches for use in complex industrial systems and provides recommendations on the types of methods to use during future situation awareness assessments. (C) 2008 Elsevier B.V. All rights reserved.
引用
收藏
页码:490 / 500
页数:11
相关论文
共 40 条
[1]  
Annett J., 2002, Theorectical Issues in Ergonomics Science, V3, P228, DOI [10.1080/14639220210124067, DOI 10.1080/14639220210124067]
[2]  
[Anonymous], 2000, SITUATION AWARENESS, DOI DOI 10.1201/B12461
[3]  
[Anonymous], 2002, 1795 US ARM RES I BE
[4]  
[Anonymous], 2001, P 2 INT WORKSH SYMB
[5]   Team situation assessment and information distribution [J].
Artman, H .
ERGONOMICS, 2000, 43 (08) :1111-1128
[6]  
Bedny G., 1999, International Journal of Cognitive Ergonomics, V3, P63, DOI [10.1207/s15327566ijce0301_5, DOI 10.1207/S15327566IJCE0301_5]
[7]  
Bell HH, 2000, SITUATION AWARENESS ANALYSIS AND MEASUREMENT, P129
[8]  
Durso Francis T, 1998, Air Trafc Control Quarterly, V6, P1, DOI [10.2514/atcq.6.1.1, DOI 10.2514/ATCQ.6.1.1]
[9]  
Endsley M.R., 2000, P HUM PERF SIT AW AU
[10]  
Endsley M.R., 1993, International Journal of Aviation Psychology, V3, P157, DOI DOI 10.1207/s15327108ijap0302_5