Medical artificial intelligence for clinicians: the lost cognitive perspective

被引:10
作者
Tikhomirov, Lana [1 ]
Semmler, Carolyn [3 ]
McCradden, Melissa [1 ,2 ]
Searston, Rachel [3 ]
Ghassemi, Marzyeh [4 ,5 ]
Oakden-Rayner, Lauren [1 ]
机构
[1] Univ Adelaide, Australian Inst Machine Learning, Adelaide, SA 5000, Australia
[2] Univ Toronto, Hosp Sick Children, Sch Publ Hlth, Toronto, ON, Canada
[3] Univ Adelaide, Sch Psychol, Adelaide, SA, Australia
[4] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02139 USA
[5] MIT, Inst Med & Evaluat Sci, Cambridge, MA USA
关键词
DECISION-MAKING; AUTOMATION;
D O I
10.1016/S2589-7500(24)00095-5
中图分类号
R-058 [];
学科分类号
摘要
The development and commercialisation of medical decision systems based on artificial intelligence (AI) far outpaces our understanding of their value for clinicians. Although applicable across many forms of medicine, we focus on characterising the diagnostic decisions of radiologists through the concept of ecologically bounded reasoning, review the differences between clinician decision making and medical AI model decision making, and reveal how these differences pose fundamental challenges for integrating AI into radiology. We argue that clinicians are contextually motivated, mentally resourceful decision makers, whereas AI models are contextually stripped, correlational decision makers, and discuss misconceptions about clinician-AI interaction stemming from this misalignment of capabilities. We outline how future research on clinician-AI interaction could better address the cognitive considerations of decision making and be used to enhance the safety and usability of AI models in high-risk medical decision-making contexts.
引用
收藏
页码:e589 / e594
页数:6
相关论文
共 60 条
[1]   Mandating Limits on Workload, Duty, and Speed in Radiology [J].
Alexander, Robert ;
Waite, Stephen ;
Bruno, Michael A. ;
Krupinski, Elizabeth A. ;
Berlin, Leonard ;
Macknik, Stephen ;
Martinez-Conde, Susana .
RADIOLOGY, 2022, 304 (02) :274-282
[2]   To explain or not to explain?-Artificial intelligence explainability in clinical decision support systems [J].
Amann, Julia ;
Vetter, Dennis ;
Blomberg, Stig Nikolaj ;
Christensen, Helle Collatz ;
Coffee, Megan ;
Gerke, Sara ;
Gilbert, Thomas K. ;
Hagendorff, Thilo ;
Holm, Sune ;
Livne, Michelle ;
Spezzatti, Andy ;
Strumke, Inga ;
Zicari, Roberto, V ;
Madai, Vince Istvan .
PLOS DIGITAL HEALTH, 2022, 1 (02)
[3]   Evaluating Fairness of Machine Learning Models Under Uncertain and Incomplete Information [J].
Awasthi, Pranjal ;
Beutel, Alex ;
Kleindessner, Matthäus ;
Morgenstern, Jamie ;
Wang, Xuezhi .
PROCEEDINGS OF THE 2021 ACM CONFERENCE ON FAIRNESS, ACCOUNTABILITY, AND TRANSPARENCY, FACCT 2021, 2021, :206-214
[4]   Deep learning predicts hip fracture using confounding patient and healthcare variables [J].
Badgeley, Marcus A. ;
Zech, John R. ;
Oakden-Rayner, Luke ;
Glicksberg, Benjamin S. ;
Liu, Manway ;
Gale, William ;
McConnell, Michael, V ;
Percha, Bethany ;
Snyder, Thomas M. ;
Dudley, Joel T. .
NPJ DIGITAL MEDICINE, 2019, 2 (1)
[5]   When Artificial Intelligence Models Surpass Physician Performance: Medical Malpractice Liability in an Era of Advanced Artificial Intelligence [J].
Banja, John D. ;
Hollstein, Rolf Dieter ;
Bruno, Michael A. .
JOURNAL OF THE AMERICAN COLLEGE OF RADIOLOGY, 2022, 19 (07) :816-820
[6]   Trust in AI: why we should be designing for APPROPRIATE reliance [J].
Benda, Natalie C. ;
Novak, Laurie L. ;
Reale, Carrie ;
Ancker, Jessica S. .
JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION, 2021, 29 (01) :207-212
[7]   How Cognitive Biases Affect XAI-assisted Decision-making: A Systematic Review [J].
Bertrand, Astrid ;
Belloum, Rafik ;
Eagan, James R. ;
Maxwell, Winston .
PROCEEDINGS OF THE 2022 AAAI/ACM CONFERENCE ON AI, ETHICS, AND SOCIETY, AIES 2022, 2022, :78-91
[8]   KEY CONCEPTS SERIES Bayes' rule in diagnosis [J].
Bours, Martijn J. L. .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2021, 131 :158-160
[9]   REPRESENTATIVE DESIGN AND PROBABILISTIC THEORY IN A FUNCTIONAL PSYCHOLOGY [J].
BRUNSWIK, E .
PSYCHOLOGICAL REVIEW, 1955, 62 (03) :193-217
[10]   Effects of working memory, attention, and expertise on pilots' situation awareness [J].
Cak, Serkan ;
Say, Bilge ;
Misirlisoy, Mine .
COGNITION TECHNOLOGY & WORK, 2020, 22 (01) :85-94