Optimizing adult-oriented artificial intelligence for pediatric chest radiographs by adjusting operating points

被引:0
作者
Shin, Hyun Joo [1 ,2 ]
Han, Kyunghwa [3 ]
Son, Nak-Hoon [4 ]
Kim, Eun-Kyung [1 ,2 ]
Kim, Min Jung [5 ]
Gatidis, Sergios [6 ]
Vasanawala, Shreyas [6 ]
机构
[1] Yonsei Univ, Yongin Severance Hosp, Res Inst Radiol Sci, Dept Radiol,Coll Med, 363 Dongbaekjukjeon Daero, Yongin 16995, Gyeonggi Do, South Korea
[2] Yonsei Univ, Coll Med, Ctr Clin Imaging Data Sci, 363 Dongbaekjukjeon Daero, Yongin 16995, Gyeonggi Do, South Korea
[3] Yonsei Univ, Severance Hosp, Res Inst Radiol Sci, Dept Radiol,Coll Med, 50-1 Yonsei Ro, Seoul 03722, South Korea
[4] Keimyung Univ, Dept Stat, 1095 Dalgubeol Daero, Daegu 42601, South Korea
[5] Yonsei Univ, Yongin Severance Hosp, Coll Med, Dept Pediat, 363 Dongbaekjukjeon Daero, Yongin 16995, Gyeonggi Do, South Korea
[6] Stanford Univ, Lucile Packard Childrens Hosp, Dept Radiol, 725 Welch Rd, Palo Alto, CA 94304 USA
来源
SCIENTIFIC REPORTS | 2024年 / 14卷 / 01期
关键词
Child; Artificial intelligence; ROC curve; Radiologists; Pneumothorax; RADIOLOGY; PAPER;
D O I
10.1038/s41598-024-82775-z
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The purpose of this study was to evaluate whether the optimal operating points of adult-oriented artificial intelligence (AI) software differ for pediatric chest radiographs and to assess its diagnostic performance. Chest radiographs from patients under 19 years old, collected between March and November 2021, were divided into test and exploring sets. A commercial adult-oriented AI software was utilized to detect lung lesions, including pneumothorax, consolidation, nodule, and pleural effusion, using a standard operating point of 15%. A pediatric radiologist reviewed the radiographs to establish ground truth for lesion presence. To determine the optimal operating points, receiver operating characteristic (ROC) curve analysis was conducted, varying thresholds to balance sensitivity and specificity by lesion type, age group, and imaging method. The test set (4,727 chest radiographs, mean 7.2 +/- 6.1 years) and exploring set (2,630 radiographs, mean 5.9 +/- 6.0 years) yielded optimal operating points of 11% for pneumothorax, 14% for consolidation, 15% for nodules, and 6% for pleural effusion. Using a 3% operating point improved pneumothorax sensitivity for children under 2 years, portable radiographs, and anteroposterior projections. Therefore, optimizing operating points of AI based on lesion type, age, and imaging method could improve diagnostic performance for pediatric chest radiographs, building on adult-oriented AI as a foundation.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Artificial intelligence to identify fractures on pediatric and young adult upper extremity radiographs
    Zech, John R.
    Jaramillo, Diego
    Altosaar, Jaan
    Popkin, Charles A.
    Wong, Tony T.
    PEDIATRIC RADIOLOGY, 2023, 53 (12) : 2386 - 2397
  • [2] Artificial intelligence to identify fractures on pediatric and young adult upper extremity radiographs
    John R. Zech
    Diego Jaramillo
    Jaan Altosaar
    Charles A. Popkin
    Tony T. Wong
    Pediatric Radiology, 2023, 53 : 2386 - 2397
  • [3] Applying Artificial Intelligence to Pediatric Chest Imaging: Reliability of Leveraging Adult-Based Artificial Intelligence Models
    Morcos, George
    Yi, Paul H.
    Jeudy, Jean
    JOURNAL OF THE AMERICAN COLLEGE OF RADIOLOGY, 2023, 20 (08) : 742 - 747
  • [4] Artificial intelligence system for identification of false-negative interpretations in chest radiographs
    Hwang, Eui Jin
    Park, Jongsoo
    Hong, Wonju
    Lee, Hyun-Ju
    Choi, Hyewon
    Kim, Hyungjin
    Nam, Ju Gang
    Goo, Jin Mo
    Yoon, Soon Ho
    Lee, Chang Hyun
    Park, Chang Min
    EUROPEAN RADIOLOGY, 2022, 32 (07) : 4468 - 4478
  • [5] Artificial Intelligence-Based Detection of Pneumonia in Chest Radiographs
    Becker, Judith
    Decker, Josua A.
    Roemmele, Christoph
    Kahn, Maria
    Messmann, Helmut
    Wehler, Markus
    Schwarz, Florian
    Kroencke, Thomas
    Scheurig-Muenkler, Christian
    DIAGNOSTICS, 2022, 12 (06)
  • [6] Pneumothorax detection in chest radiographs: optimizing artificial intelligence system for accuracy and confounding bias reduction using in-image annotations in algorithm training
    Rueckel, Johannes
    Huemmer, Christian
    Fieselmann, Andreas
    Ghesu, Florin-Cristian
    Mansoor, Awais
    Schachtner, Balthasar
    Wesp, Philipp
    Trappmann, Lena
    Munawwar, Basel
    Ricke, Jens
    Ingrisch, Michael
    Sabel, Bastian O.
    EUROPEAN RADIOLOGY, 2021, 31 (10) : 7888 - 7900
  • [7] Pneumothorax detection in chest radiographs: optimizing artificial intelligence system for accuracy and confounding bias reduction using in-image annotations in algorithm training
    Johannes Rueckel
    Christian Huemmer
    Andreas Fieselmann
    Florin-Cristian Ghesu
    Awais Mansoor
    Balthasar Schachtner
    Philipp Wesp
    Lena Trappmann
    Basel Munawwar
    Jens Ricke
    Michael Ingrisch
    Bastian O. Sabel
    European Radiology, 2021, 31 : 7888 - 7900
  • [8] Effectiveness of artificial intelligence for detecting operable lung cancer on chest radiographs
    Shin, Hyun Joo
    Kwak, Se Hyun
    Kim, Kyeong Yeon
    Kim, Na Young
    Nam, Kyungsun
    Kim, Young Jin
    Kim, Eun-Kyung
    Suh, Young Joo
    Lee, Eun Hye
    TRANSLATIONAL LUNG CANCER RESEARCH, 2024, 13 (12) : 3473 - 3485
  • [9] Factors for increasing positive predictive value of pneumothorax detection on chest radiographs using artificial intelligence
    Lee, Seungsoo
    Kim, Eun-Kyung
    Han, Kyunghwa
    Ryu, Leeha
    Lee, Eun Hye
    Shin, Hyun Joo
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [10] Artificial intelligence-driven automated lung sizing from chest radiographs
    Ismail, Mostafa K.
    Araki, Tetsuro
    Gefter, Warren B.
    Suzuki, Yoshikazu
    Raevsky, Allie
    Saleh, Aya
    Yusuf, Sophia
    Marquis, Abigail
    Alcudia, Alyster
    Duncan, Ian
    Schaubel, Douglas E.
    Cantu, Edward
    Rizi, Rahim
    AMERICAN JOURNAL OF TRANSPLANTATION, 2025, 25 (01) : 198 - 203