Automation bias and verification complexity: a systematic review

被引:162
作者
Lyell, David [1 ]
Coiera, Enrico [1 ]
机构
[1] Macquarie Univ, Australian Inst Hlth Innovat, Ctr Hlth Informat, Sydney, NSW 2109, Australia
关键词
decision support systems; clinical cognitive biases; complexity; CLINICAL DECISION-SUPPORT; HUMAN-PERFORMANCE CONSEQUENCES; TASK COMPLEXITY; RELIABILITY; AIDS; COMPLACENCY; IMPACT; MANAGEMENT; DIFFICULTY; CAD;
D O I
10.1093/jamia/ocw105
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Introduction: While potentially reducing decision errors, decision support systems can introduce new types of errors. Automation bias (AB) happens when users become overreliant on decision support, which reduces vigilance in information seeking and processing. Most research originates from the human factors literature, where the prevailing view is that AB occurs only in multitasking environments. Objectives: This review seeks to compare the human factors and health care literature, focusing on the apparent association of AB with multitasking and task complexity. Data sources: EMBASE, Medline, Compendex, Inspec, IEEE Xplore, Scopus, Web of Science, PsycINFO, and Business Source Premiere from 1983 to 2015. Study selection: Evaluation studies where task execution was assisted by automation and resulted in errors were included. Participants needed to be able to verify automation correctness and perform the task manually. Methods: Tasks were identified and grouped. Task and automation type and presence of multitasking were noted. Each task was rated for its verification complexity. Results: Of 890 papers identified, 40 met the inclusion criteria; 6 were in health care. Contrary to the prevailing human factors view, AB was found in single tasks, typically involving diagnosis rather than monitoring, and with high verification complexity. Limitations: The literature is fragmented, with large discrepancies in how AB is reported. Few studies reported the statistical significance of AB compared to a control condition. Conclusion: AB appears to be associated with the degree of cognitive load experienced in decision tasks, and appears to not be uniquely associated with multitasking. Strategies to minimize AB might focus on cognitive load reduction.
引用
收藏
页码:423 / 431
页数:9
相关论文
共 60 条
[1]   Effects of incorrect computer-aided detection (CAD) output on human decision-making in mammography [J].
Alberdi, E ;
Povyakalo, A ;
Strigini, L ;
Ayton, P .
ACADEMIC RADIOLOGY, 2004, 11 (08) :909-918
[2]  
Amalberti R., 1997, Aviation Safety: Human Factors, System Engineering, Flight Operations, Economics, Strategies, Management, P91
[3]  
[Anonymous], 2012, THESIS
[4]  
[Anonymous], 1976, TMX3445 NASA AM RES
[5]  
[Anonymous], CONSIDERING SUBJECTI
[6]  
[Anonymous], P HUM FACT ERG SOC A
[7]  
Bagheri N, 2004, IEEE SYS MAN CYBERN, P212
[8]  
Bahner J. Elin, 2008, Proceedings of the Human Factors and Ergonomics Society. 52nd Annual Meeting, P1330
[9]   Misuse of automated decision aids:: Complacency, automation bias and the impact of training experience [J].
Bahner, J. Elin ;
Hueper, Anke-Dorothea ;
Manzey, Dietrich .
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2008, 66 (09) :688-699
[10]   Automation-induced complacency for monitoring highly reliable systems: the role of task complexity, system experience, and operator trust [J].
Bailey, N. R. ;
Scerbo, M. W. .
THEORETICAL ISSUES IN ERGONOMICS SCIENCE, 2007, 8 (04) :321-348