Why do errors arise in artificial intelligence diagnostic tools in histopathology and how can we minimize them?

被引:14
作者
Evans, Harriet [1 ,2 ]
Snead, David [1 ,2 ]
机构
[1] Univ Hosp Coventry & Warwickshire NHS Trust, Histopathol Dept, Clifford Bridge Rd, Coventry CV2 2DX, England
[2] Univ Warwick, Warwick Med Sch, Coventry, England
关键词
artificial intelligence; errors; harm minimisation; histopathology; safety; AI; PATHOLOGY;
D O I
10.1111/his.15071
中图分类号
Q2 [细胞生物学];
学科分类号
071009 ; 090102 ;
摘要
Artificial intelligence (AI)-based diagnostic tools can offer numerous benefits to the field of histopathology, including improved diagnostic accuracy, efficiency and productivity. As a result, such tools are likely to have an increasing role in routine practice. However, all AI tools are prone to errors, and these AI-associated errors have been identified as a major risk in the introduction of AI into healthcare. The errors made by AI tools are different, in terms of both cause and nature, to the errors made by human pathologists. As highlighted by the National Institute for Health and Care Excellence, it is imperative that practising pathologists understand the potential limitations of AI tools, including the errors made. Pathologists are in a unique position to be gatekeepers of AI tool use, maximizing patient benefit while minimizing harm. Furthermore, their pathological knowledge is essential to understanding when, and why, errors have occurred and so to developing safer future algorithms. This paper summarises the literature on errors made by AI diagnostic tools in histopathology. These include erroneous errors, data concerns (data bias, hidden stratification, data imbalances, distributional shift, and lack of generalisability), reinforcement of outdated practices, unsafe failure mode, automation bias, and insensitivity to impact. Methods to reduce errors in both tool design and clinical use are discussed, and the practical roles for pathologists in error minimisation are highlighted. This aims to inform and empower pathologists to move safely through this seismic change in practice and help ensure that novel AI tools are adopted safely.
引用
收藏
页码:279 / 287
页数:9
相关论文
共 70 条
[1]  
Amodei D., CONCRETE PROBLEMS AI
[2]   A review of artificial. intelligence in prostate cancer detection on imaging [J].
Bhattacharya, Indrani ;
Khandwala, Yash S. ;
Vesal, Sulaiman ;
Shao, Wei ;
Yang, Qianye ;
Soerensen, Simon J. C. ;
Fan, Richard E. ;
Ghanouni, Pejman ;
Kunder, Christian A. ;
Brooks, James D. ;
Hu, Yipeng ;
Rusu, Mirabela ;
Sonn, Geoffrey A. .
THERAPEUTIC ADVANCES IN UROLOGY, 2022, 14
[3]  
Burnett G. E., 2019, How will drivers interact with vehicles of the future?
[4]   Artificial intelligence, bias and clinical safety [J].
Challen, Robert ;
Denny, Joshua ;
Pitt, Martin ;
Gompels, Luke ;
Edwards, Tom ;
Tsaneva-Atanasova, Krasimira .
BMJ QUALITY & SAFETY, 2019, 28 (03) :231-237
[5]   Ethics of AI in Pathology Current Paradigms and Emerging Issues [J].
Chauhan, Chhavi ;
Gullapalli, Rama R. .
AMERICAN JOURNAL OF PATHOLOGY, 2021, 191 (10) :1673-1683
[6]   Artificial intelligence in digital pathology: a roadmap to routine use in clinical practice [J].
Colling, Richard ;
Pitman, Helen ;
Oien, Karin ;
Rajpoot, Nasir ;
Macklin, Philip ;
Snead, David ;
Sackville, Tony ;
Verrill, Clare ;
Bachtiar, Velicia ;
Booth, Richard ;
Bryant, Alyson ;
Bull, Joshua ;
Bury, Jonathan ;
Carragher, Fiona ;
Collins, Graeme ;
Craig, Clare ;
da Silva, Maria Freitas ;
Gosling, Daniel ;
Jacobs, Jaco ;
Kajland-Wilen, Lena ;
Karlin, Johanna ;
Lawler, Darragh ;
Lee, Stephen ;
Miller, Keith ;
Mozolowski, Guy ;
Nicholson, Richard ;
O'Connor, Daniel ;
Rahbek, Mikkel ;
Sumner, Alan ;
Vossen, Dirk ;
White, Kieron ;
Wing, Charlotte ;
Wright, Corrina .
JOURNAL OF PATHOLOGY, 2019, 249 (02) :143-150
[7]   A Survey on Deep Learning with Noisy Labels: How to train your model when you cannot trust on the annotations? [J].
Cordeiro, Filipe R. ;
Carneiro, Gustavo .
2020 33RD SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI 2020), 2020, :9-16
[8]   Artificial intelligence and computational pathology [J].
Cui, Miao ;
Zhang, David Y. .
LABORATORY INVESTIGATION, 2021, 101 (04) :412-422
[9]   Independent real-world application of a clinical-grade automated prostate cancer detection system [J].
da Silva, Leonard M. ;
Pereira, Emilio M. ;
Salles, Paulo G. O. ;
Godrich, Ran ;
Ceballos, Rodrigo ;
Kunz, Jeremy D. ;
Casson, Adam ;
Viret, Julian ;
Chandarlapaty, Sarat ;
Ferreira, Carlos Gil ;
Ferrari, Bruno ;
Rothrock, Brandon ;
Raciti, Patricia ;
Reuter, Victor ;
Dogdas, Belma ;
DeMuth, George ;
Sue, Jillian ;
Kanan, Christopher ;
Grady, Leo ;
Fuchs, Thomas J. ;
Reis-Filho, Jorge S. .
JOURNAL OF PATHOLOGY, 2021, 254 (02) :147-158
[10]   What is morally at stake when using algorithms to make medical diagnoses? Expanding the discussion beyond risks and harms [J].
de Boer, Bas ;
Kudina, Olya .
THEORETICAL MEDICINE AND BIOETHICS, 2021, 42 (5-6) :245-266