Deep learning improves physician accuracy in the comprehensive detection of abnormalities on chest X-rays

被引:4
作者
Anderson, Pamela G. [1 ]
Tarder-Stoll, Hannah [1 ]
Alpaslan, Mehmet [1 ]
Keathley, Nora [1 ]
Levin, David L. [2 ]
Venkatesh, Srivas [1 ]
Bartel, Elliot [1 ]
Sicular, Serge [1 ,3 ]
Howell, Scott [1 ]
Lindsey, Robert V. [1 ]
Jones, Rebecca M. [1 ]
机构
[1] Imagen Technol, 224 W 35th St,Ste 500, New York, NY 10001 USA
[2] Stanford Univ, Sch Med, Dept Radiol, 453 Quarry Rd, Palo Alto, CA 94305 USA
[3] Mt Sinai Hosp, 1 Gustave L Levy Pl, New York, NY 10029 USA
来源
SCIENTIFIC REPORTS | 2024年 / 14卷 / 01期
关键词
EMERGENCY-DEPARTMENT; DIAGNOSTIC ERRORS; RADIOLOGY; RADIOGRAPHS; EDUCATION; ACCIDENT;
D O I
10.1038/s41598-024-76608-2
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Chest X-rays are the most commonly performed medical imaging exam, yet they are often misinterpreted by physicians. Here, we present an FDA-cleared, artificial intelligence (AI) system which uses a deep learning algorithm to assist physicians in the comprehensive detection and localization of abnormalities on chest X-rays. We trained and tested the AI system on a large dataset, assessed generalizability on publicly available data, and evaluated radiologist and non-radiologist physician accuracy when unaided and aided by the AI system. The AI system accurately detected chest X-ray abnormalities (AUC: 0.976, 95% bootstrap CI: 0.975, 0.976) and generalized to a publicly available dataset (AUC: 0.975, 95% bootstrap CI: 0.971, 0.978). Physicians showed significant improvements in detecting abnormalities on chest X-rays when aided by the AI system compared to when unaided (difference in AUC: 0.101, p < 0.001). Non-radiologist physicians detected abnormalities on chest X-ray exams as accurately as radiologists when aided by the AI system and were faster at evaluating chest X-rays when aided compared to unaided. Together, these results show that the AI system is accurate and reduces physician errors in chest X-ray evaluation, which highlights the potential of AI systems to improve access to fast, high-quality radiograph interpretation.
引用
收藏
页数:13
相关论文
共 82 条
[1]  
accessdata, 2021, K210666 U.S. Food & Drug Administration
[2]  
[Anonymous], 2016, Review of an Alleged Radiology Exam Backlog at the W.G. (Bill) Hefner VA Medical Center in Salisbury, NC
[3]   Advanced Imaging Interpretation by Radiologists and Nonradiologist Physicians: A Training Issue [J].
Atsina, Kofi-Buaku ;
Parker, Laurence ;
Rao, Vijay M. ;
Levin, David C. .
AMERICAN JOURNAL OF ROENTGENOLOGY, 2020, 214 (01) :W55-W61
[4]   Malpractice Suits in Chest Radiology An Evaluation of the Histories of 8265 Radiologists [J].
Baker, Stephen R. ;
Patel, Ronak H. ;
Yang, Lily .
JOURNAL OF THORACIC IMAGING, 2013, 28 (06) :388-391
[5]   Comparison of Deep Learning Approaches for Multi-Label Chest X-Ray Classification [J].
Baltruschat, Ivo M. ;
Nickisch, Hannes ;
Grass, Michael ;
Knopp, Tobias ;
Saalbach, Axel .
SCIENTIFIC REPORTS, 2019, 9 (1)
[6]   The state of artificial intelligence-based FDA-approved medical devices and algorithms: an online database [J].
Benjamens, Stan ;
Dhunnoo, Pranavsingh ;
Mesko, Bertalan .
NPJ DIGITAL MEDICINE, 2020, 3 (01)
[7]   Satisfaction of Search in Chest Radiography 2015 [J].
Berbaum, Kevin S. ;
Krupinski, Elizabeth A. ;
Schartz, Kevin M. ;
Caldwell, Robert T. ;
Madsen, Mark T. ;
Hur, Seung ;
Laroia, Archana T. ;
Thompson, Brad H. ;
Mullan, Brian F. ;
Franken, Edmund A., Jr. .
ACADEMIC RADIOLOGY, 2015, 22 (11) :1457-1465
[8]   Malpractice issues in radiology - Defending the "missed" radiographic diagnosis [J].
Berlin, L .
AMERICAN JOURNAL OF ROENTGENOLOGY, 2001, 176 (02) :317-322
[9]   Accuracy of diagnostic procedures: Has it improved over the past five decades? [J].
Berlin, Leonard .
AMERICAN JOURNAL OF ROENTGENOLOGY, 2007, 188 (05) :1173-1178
[10]   Workload of Radiologists in United States in 2006-2007 and Trends Since 1991-1992 [J].
Bhargavan, Mythreyi ;
Kaye, Adam H. ;
Forman, Howard P. ;
Sunshine, Jonathan H. .
RADIOLOGY, 2009, 252 (02) :458-467