Deep Learning-Enabled Detection of Pneumoperitoneum in Supine and Erect Abdominal Radiography: Modeling Using Transfer Learning and Semi-Supervised Learning

被引:4
作者
Park, Sangjoon [1 ]
Ye, Jong Chul [2 ]
Lee, Eun Sun [3 ,4 ]
Cho, Gyeongme [3 ]
Yoon, Jin Woo [3 ]
Choi, Joo Hyeok [3 ]
Joo, Ijin [5 ]
Lee, Yoon Jin [6 ]
机构
[1] Korea Adv Inst Sci & Technol, Dept Bio & Brain Engn, Daejeon, South Korea
[2] Korea Adv Inst Sci & Technol, Kim Jaechul Grad Sch AI, Daejeon, South Korea
[3] Chung Ang Univ, Chung Ang Univ Hosp, Dept Radiol, Coll Med, Seoul, South Korea
[4] Chung Ang Univ Hosp, Biomed Res Inst, Seoul, South Korea
[5] Seoul Natl Univ Hosp, Dept Radiol, Seoul, South Korea
[6] Seoul Natl Univ, Dept Radiol, Bundang Hosp, Seongnam, South Korea
关键词
Abdominal radiography; Deep learning; Artificial intelligence; Pneumoperitoneum; Transfer learning; Pretraining; Knowledge distillation; DIAGNOSIS;
D O I
10.3348/kjr.2022.1032
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Objective: Detection of pneumoperitoneum using abdominal radiography, particularly in the supine position, is often challenging. This study aimed to develop and externally validate a deep learning model for the detection of pneumoperitoneum using supine and erect abdominal radiography. Materials and Methods: A model that can utilize "pneumoperitoneum" and "non-pneumoperitoneum" classes was developed through knowledge distillation. To train the proposed model with limited training data and weak labels, it was trained using a recently proposed semi-supervised learning method called distillation for self-supervised and self-train learning (DISTL), which leverages the Vision Transformer. The proposed model was first pre-trained with chest radiographs to utilize common knowledge between modalities, fine-tuned, and self-trained on labeled and unlabeled abdominal radiographs. The proposed model was trained using data from supine and erect abdominal radiographs. In total, 191212 chest radiographs (CheXpert data) were used for pre-training, and 5518 labeled and 16671 unlabeled abdominal radiographs were used for fine-tuning and self-supervised learning, respectively. The proposed model was internally validated on 389 abdominal radiographs and externally validated on 475 and 798 abdominal radiographs from the two institutions. We evaluated the performance in diagnosing pneumoperitoneum using the area under the receiver operating characteristic curve (AUC) and compared it with that of radiologists. Results: In the internal validation, the proposed model had an AUC, sensitivity, and specificity of 0.881, 85.4%, and 73.3% and 0.968, 91.1, and 95.0 for supine and erect positions, respectively. In the external validation at the two institutions, the AUCs were 0.835 and 0.852 for the supine position and 0.909 and 0.944 for the erect position. In the reader study, the readers' performances improved with the assistance of the proposed model. Conclusion: The proposed model trained with the DISTL method can accurately detect pneumoperitoneum on abdominal radiography in both the supine and erect positions.
引用
收藏
页码:541 / 552
页数:12
相关论文
共 29 条
[1]   Emerging Properties in Self-Supervised Vision Transformers [J].
Caron, Mathilde ;
Touvron, Hugo ;
Misra, Ishan ;
Jegou, Herve ;
Mairal, Julien ;
Bojanowski, Piotr ;
Joulin, Armand .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :9630-9640
[2]  
Chan SY, 1996, WESTERN J MED, V165, P61
[3]   Self-supervised learning for medical image analysis using image context restoration [J].
Chen, Liang ;
Bentley, Paul ;
Mori, Kensaku ;
Misawa, Kazunari ;
Fujiwara, Michitaka ;
Rueckert, Daniel .
MEDICAL IMAGE ANALYSIS, 2019, 58
[4]   Ultrasonography is superior to plain radiography in the diagnosis of pneumoperitoneum [J].
Chen, SC ;
Yen, ZS ;
Wang, HP ;
Lin, FY ;
Hsu, CY ;
Chen, WJ .
BRITISH JOURNAL OF SURGERY, 2002, 89 (03) :351-354
[5]   Not-so-supervised: A survey of semi-supervised, multi-instance, and transfer learning in medical image analysis [J].
Cheplygina, Veronika ;
de Bruijne, Marleen ;
Pluim, Josien P. W. .
MEDICAL IMAGE ANALYSIS, 2019, 54 :280-296
[6]   Clinically applicable deep learning for diagnosis and referral in retinal disease [J].
De Fauw, Jeffrey ;
Ledsam, Joseph R. ;
Romera-Paredes, Bernardino ;
Nikolov, Stanislav ;
Tomasev, Nenad ;
Blackwell, Sam ;
Askham, Harry ;
Glorot, Xavier ;
O'Donoghue, Brendan ;
Visentin, Daniel ;
van den Driessche, George ;
Lakshminarayanan, Balaji ;
Meyer, Clemens ;
Mackinder, Faith ;
Bouton, Simon ;
Ayoub, Kareem ;
Chopra, Reena ;
King, Dominic ;
Karthikesalingam, Alan ;
Hughes, Cian O. ;
Raine, Rosalind ;
Hughes, Julian ;
Sim, Dawn A. ;
Egan, Catherine ;
Tufail, Adnan ;
Montgomery, Hugh ;
Hassabis, Demis ;
Rees, Geraint ;
Back, Trevor ;
Khaw, Peng T. ;
Suleyman, Mustafa ;
Cornebise, Julien ;
Keane, Pearse A. ;
Ronneberger, Olaf .
NATURE MEDICINE, 2018, 24 (09) :1342-+
[7]   COMPARING THE AREAS UNDER 2 OR MORE CORRELATED RECEIVER OPERATING CHARACTERISTIC CURVES - A NONPARAMETRIC APPROACH [J].
DELONG, ER ;
DELONG, DM ;
CLARKEPEARSON, DI .
BIOMETRICS, 1988, 44 (03) :837-845
[8]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
[9]   Postoperative pneumoperitoneum: Prevalence, duration, and possible significance [J].
Gayer, G ;
Hertz, M ;
Zissin, R .
SEMINARS IN ULTRASOUND CT AND MRI, 2004, 25 (03) :286-289
[10]   Knowledge Distillation: A Survey [J].
Gou, Jianping ;
Yu, Baosheng ;
Maybank, Stephen J. ;
Tao, Dacheng .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (06) :1789-1819