Deep Learning-Assisted Diagnosis of Pediatric Skull Fractures on Plain Radiographs

被引:23
作者
Choi, Jae Won [1 ,2 ]
Cho, Yeon Jin [1 ,4 ]
Ha, Ji Young [5 ]
Lee, Yun Young [6 ]
Koh, Seok Young [4 ]
Seo, June Young [4 ]
Choi, Young Hun [1 ,4 ]
Cheon, Jung-Eun [1 ,4 ,7 ]
Phi, Ji Hoon [8 ]
Kim, Injoon [3 ]
Yang, Jaekwang [9 ]
Kim, Woo Sun [1 ,4 ,7 ]
机构
[1] Seoul Natl Univ, Dept Radiol, Coll Med, Seoul, South Korea
[2] Armed Forces Yangju Hosp, Dept Radiol, Yangju, South Korea
[3] Armed Forces Yangju Hosp, Dept Emergency Med, Yangju, South Korea
[4] Seoul Natl Univ Hosp, Dept Radiol, 101 Daehak Ro, Seoul 03080, South Korea
[5] Gyeongsang Natl Univ, Dept Radiol, Changwon Hosp, Chang Won, South Korea
[6] Chonnam Natl Univ Hosp, Dept Radiol, Gwangju, South Korea
[7] Seoul Natl Univ, Inst Radiat Med, Med Res Ctr, Seoul, South Korea
[8] Seoul Natl Univ, Div Pediat Neurosurg, Childrens Hosp, Seoul, South Korea
[9] Army Aviat Operat Command, Icheon, South Korea
关键词
Deep learning; Artificial intelligence; Skull fracture; Pediatric; Plain radiograph; COMPUTED-TOMOGRAPHY; CHILDREN YOUNGER; HEAD TRAUMA; INJURY; EPIDEMIOLOGY; VALIDATION;
D O I
10.3348/kjr.2021.0449
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Objective: To develop and evaluate a deep learning-based artificial intelligence (AI) model for detecting skull fractures on plain radiographs in children. Materials and Methods: This retrospective multi-center study consisted of a development dataset acquired from two hospitals (n = 149 and 264) and an external test set (n = 95) from a third hospital. Datasets included children with head trauma who underwent both skull radiography and cranial computed tomography (CT). The development dataset was split into training, tuning, and internal test sets in a ratio of 7:1:2. The reference standard for skull fracture was cranial CT. Two radiology residents, a pediatric radiologist, and two emergency physicians participated in a two-session observer study on an external test set with and without AI assistance. We obtained the area under the receiver operating characteristic curve (AUROC), sensitivity, and specificity along with their 95% confidence intervals (CIs). Results: The AI model showed an AUROC of 0.922 (95% CI, 0.842-0.969) in the internal test set and 0.870 (95% CI, 0.785-0.930) in the external test set. The model had a sensitivity of 81.1% (95% CI, 64.8%-92.0%) and specificity of 91.3% (95% CI, 79.2%-97.6%) for the internal test set and 78.9% (95% CI, 54.4%-93.9%) and 88.2% (95% CI, 78.7%- 94.4%), respectively, for the external test set. With the model's assistance, significant AUROC improvement was observed in radiology residents (pooled results) and emergency physicians (pooled results) with the difference from reading without AI assistance of 0.094 (95% CI, 0.020-0.168; p = 0.012) and 0.069 (95% CI, 0.002-0.136; p = 0.043), respectively, but not in the pediatric radiologist with the difference of 0.008 (95% CI, -0.074-0.090; p = 0.850). Conclusion: A deep learning-based AI model improved the performance of inexperienced radiologists and emergency physicians in diagnosing pediatric skull fractures on plain radiographs.
引用
收藏
页码:343 / 354
页数:12
相关论文
共 43 条
[1]   A prospective observational study to assess the diagnostic accuracy of clinical decision rules for children presenting to emergency departments after head injuries (protocol): the Australasian Paediatric Head Injury Rules Study (APHIRST) [J].
Babl, Franz E. ;
Lyttle, Mark D. ;
Bressan, Silvia ;
Borland, Meredith ;
Phillips, Natalie ;
Kochar, Amit ;
Dalziel, Stuart R. ;
Dalton, Sarah ;
Cheek, John A. ;
Furyk, Jeremy ;
Gilhotra, Yuri ;
Neutze, Jocelyn ;
Ward, Brenton ;
Donath, Susan ;
Jachno, Kim ;
Crowe, Louise ;
Williams, Amanda ;
Oakley, Ed .
BMC PEDIATRICS, 2014, 14
[2]   Use of CT for Head Trauma: 2007-2015 [J].
Burstein, Brett ;
Upton, Julia E. M. ;
Terra, Heloisa Fuzaro ;
Neuman, Mark I. .
PEDIATRICS, 2018, 142 (04)
[3]   Variation in the use of skull radiographs by emergency physicians in young children with minor head trauma [J].
Carriere, Benoit ;
Clement, Karine ;
Gravel, Jocelyn .
CANADIAN JOURNAL OF EMERGENCY MEDICINE, 2014, 16 (04) :281-287
[4]  
Chakraborty D.P., 2017, Observer Performance Methods for Diagnostic Imaging, DOI DOI 10.1201/9781351228190
[5]   Current applications and future directions of deep learning in musculoskeletal radiology [J].
Chea, Pauley ;
Mandell, Jacob C. .
SKELETAL RADIOLOGY, 2020, 49 (02) :183-197
[6]   Using a Dual-Input Convolutional Neural Network for Automated Detection of Pediatric Supracondylar Fracture on Conventional Radiography [J].
Choi, Jae Won ;
Cho, Yeon Jin ;
Lee, Seowoo ;
Lee, Jihyuk ;
Lee, Seunghyun ;
Choi, Young Hun ;
Cheon, Jung-Eun ;
Ha, Ji Young .
INVESTIGATIVE RADIOLOGY, 2020, 55 (02) :101-110
[7]   Skull radiograph interpretation of children younger than two years: How good are pediatric emergency physicians? [J].
Chung, S ;
Schamban, N ;
Wypij, D ;
Cleveland, R ;
Schutzman, SA .
ANNALS OF EMERGENCY MEDICINE, 2004, 43 (06) :718-722
[8]   COMPARING THE AREAS UNDER 2 OR MORE CORRELATED RECEIVER OPERATING CHARACTERISTIC CURVES - A NONPARAMETRIC APPROACH [J].
DELONG, ER ;
DELONG, DM ;
CLARKEPEARSON, DI .
BIOMETRICS, 1988, 44 (03) :837-845
[9]  
Do S, 2020, KOREAN J RADIOL, V21, P33
[10]   The VIA Annotation Software for Images, Audio and Video [J].
Dutta, Abhishek ;
Zisserman, Andrew .
PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, :2276-2279