Artificial Intelligence for Reducing Workload in Breast Cancer Screening with Digital Breast Tomosynthesis

被引:53
作者
Shoshan, Yoel [1 ]
Bakalo, Ran [1 ]
Gilboa-Solomon, Flora [1 ]
Ratner, Vadim [1 ]
Barkan, Ella [1 ]
Ozery-Flato, Michal [1 ]
Amit, Mika [1 ]
Khapun, Daniel [1 ]
Ambinder, Emily B. [2 ]
Oluyemi, Eniola T. [2 ]
Panigrahi, Babita [2 ]
DiCarlo, Philip A. [2 ]
Rosen-Zvi, Michal [1 ]
Mullen, Lisa A. [2 ]
机构
[1] Univ Haifa Campus, IBM R&D Labs, IBM Res, Dept Healthcare Informat, IL-3498823 Haifa, Israel
[2] Johns Hopkins Med, Breast Imaging Div, Russell H Morgan Dept Radiol & Radiol Sci, Baltimore, MD USA
关键词
COEFFICIENT; MAMMOGRAPHY;
D O I
10.1148/radiol.211105
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Background: Digital breast tomosynthesis (DBT) has higher diagnostic accuracy than digital mammography, but interpretation time is substantially longer. Artificial intelligence (AI) could improve reading efficiency. Purpose: To evaluate the use of AI to reduce workload by filtering out normal DBT screens. Materials and Methods: The retrospective study included 13 306 DBT examinations from 9919 women performed between June 2013 and November 2018 from two health care networks. The cohort was split into training, validation, and test sets (3948, 1661, and 4310 women, respectively). A workflow was simulated in which the AI model classified cancer-free examinations that could be dismissed from the screening worklist and used the original radiologists' interpretations on the rest of the worklist examinations. The AI system was also evaluated with a reader study of five breast radiologists reading the DBT mammograms of 205 women. The area under the receiver operating characteristic curve (AUC), sensitivity, specificity, and recall rate were evaluated in both studies. Statistics were computed across 10 000 bootstrap samples to assess 95% CIs, noninferiority, and superiority tests. Results: The model was tested on 4310 screened women (mean age, 60 years 6 11 [standard deviation]; 5182 DBT examinations). Compared with the radiologists' performance (417 of 459 detected cancers [90.8%], 477 recalls in 5182 examinations [9.2%]), the use of AI to automatically filter out cases would result in 39.6% less workload, noninferior sensitivity (413 of 459 detected cancers; 90.0%; P =.002), and 25% lower recall rate (358 recalls in 5182 examinations; 6.9%; P =.002). In the reader study, AUC was higher in the standalone AI compared with the mean reader (0.84 vs 0.81; P =.002). Conclusion: The artificial intelligence model was able to identify normal digital breast tomosynthesis screening examinations, which decreased the number of examinations that required radiologist interpretation in a simulated clinical workflow. Published under a CC BY 4.0 license.
引用
收藏
页码:69 / 77
页数:9
相关论文
共 21 条
[1]   Predicting Breast Cancer by Applying Deep Learning to Linked Health Records and Mammograms [J].
Akselrod-Ballin, Ayelet ;
Chorev, Michal ;
Shoshan, Yoel ;
Spiro, Adam ;
Hazan, Alon ;
Melamed, Roie ;
Barkan, Ella ;
Herzel, Esma ;
Naor, Shaked ;
Karavani, Ehud ;
Koren, Gideon ;
Goldscbmidt, Yaara ;
Shalev, Varda ;
Rosen-Zvi, Michal ;
Guindy, Michal .
RADIOLOGY, 2019, 292 (02) :331-342
[2]  
[Anonymous], 2004, ALL STAT CONCISE COU
[3]  
[Anonymous], BENCHMARKS ABNORMAL
[4]   When to use the Bonferroni correction [J].
Armstrong, Richard A. .
OPHTHALMIC AND PHYSIOLOGICAL OPTICS, 2014, 34 (05) :502-508
[5]  
Bonferroni Carlo E., 1936, PUBBLICAZIONI R I SU, V8, P1, DOI DOI 10.4135/9781412961288.N455
[6]  
Bray F, 2018, CA-CANCER J CLIN, V68, P394, DOI [10.3322/caac.21492, 10.3322/caac.21609]
[7]   COEFFICIENT KAPPA - SOME USES, MISUSES, AND ALTERNATIVES [J].
BRENNAN, RL ;
PREDIGER, DJ .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1981, 41 (03) :687-699
[8]   ADVANCES IN STATISTICAL METHODOLOGY FOR THE EVALUATION OF DIAGNOSTIC AND LABORATORY TESTS [J].
CAMPBELL, G .
STATISTICS IN MEDICINE, 1994, 13 (5-7) :499-508
[9]   A COEFFICIENT OF AGREEMENT FOR NOMINAL SCALES [J].
COHEN, J .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1960, 20 (01) :37-46
[10]   Improving Accuracy and Efficiency with Concurrent Use of Artificial Intelligence for Digital Breast Tomosynthesis [J].
Conant, Emily F. ;
Toledano, Alicia Y. ;
Periaswamy, Senthil ;
Fotin, Sergei, V ;
Go, Jonathan ;
Boatsman, Justin E. ;
Hoffmeister, Jeffrey W. .
RADIOLOGY-ARTIFICIAL INTELLIGENCE, 2019, 1 (04)