Optimizing adult-oriented artificial intelligence for pediatric chest radiographs by adjusting operating points

被引:0
作者
Shin, Hyun Joo [1 ,2 ]
Han, Kyunghwa [3 ]
Son, Nak-Hoon [4 ]
Kim, Eun-Kyung [1 ,2 ]
Kim, Min Jung [5 ]
Gatidis, Sergios [6 ]
Vasanawala, Shreyas [6 ]
机构
[1] Yonsei Univ, Yongin Severance Hosp, Res Inst Radiol Sci, Dept Radiol,Coll Med, 363 Dongbaekjukjeon Daero, Yongin 16995, Gyeonggi Do, South Korea
[2] Yonsei Univ, Coll Med, Ctr Clin Imaging Data Sci, 363 Dongbaekjukjeon Daero, Yongin 16995, Gyeonggi Do, South Korea
[3] Yonsei Univ, Severance Hosp, Res Inst Radiol Sci, Dept Radiol,Coll Med, 50-1 Yonsei Ro, Seoul 03722, South Korea
[4] Keimyung Univ, Dept Stat, 1095 Dalgubeol Daero, Daegu 42601, South Korea
[5] Yonsei Univ, Yongin Severance Hosp, Coll Med, Dept Pediat, 363 Dongbaekjukjeon Daero, Yongin 16995, Gyeonggi Do, South Korea
[6] Stanford Univ, Lucile Packard Childrens Hosp, Dept Radiol, 725 Welch Rd, Palo Alto, CA 94304 USA
来源
SCIENTIFIC REPORTS | 2024年 / 14卷 / 01期
关键词
Child; Artificial intelligence; ROC curve; Radiologists; Pneumothorax; RADIOLOGY; PAPER;
D O I
10.1038/s41598-024-82775-z
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The purpose of this study was to evaluate whether the optimal operating points of adult-oriented artificial intelligence (AI) software differ for pediatric chest radiographs and to assess its diagnostic performance. Chest radiographs from patients under 19 years old, collected between March and November 2021, were divided into test and exploring sets. A commercial adult-oriented AI software was utilized to detect lung lesions, including pneumothorax, consolidation, nodule, and pleural effusion, using a standard operating point of 15%. A pediatric radiologist reviewed the radiographs to establish ground truth for lesion presence. To determine the optimal operating points, receiver operating characteristic (ROC) curve analysis was conducted, varying thresholds to balance sensitivity and specificity by lesion type, age group, and imaging method. The test set (4,727 chest radiographs, mean 7.2 +/- 6.1 years) and exploring set (2,630 radiographs, mean 5.9 +/- 6.0 years) yielded optimal operating points of 11% for pneumothorax, 14% for consolidation, 15% for nodules, and 6% for pleural effusion. Using a 3% operating point improved pneumothorax sensitivity for children under 2 years, portable radiographs, and anteroposterior projections. Therefore, optimizing operating points of AI based on lesion type, age, and imaging method could improve diagnostic performance for pediatric chest radiographs, building on adult-oriented AI as a foundation.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Artificial intelligence research within reach: an object detection model to identify rickets on pediatric wrist radiographs
    Karthik C. Meda
    Sarah S. Milla
    Bradley S. Rostad
    Pediatric Radiology, 2021, 51 : 782 - 791
  • [42] Retrospectively assessing evaluation and management of artificial-intelligence detected nodules on uninterpreted chest radiographs in the era of radiologists shortage
    Kirshenboim, Zehavit
    Gilat, Efrat Keren
    Carl, Lawrence
    Bekker, Elena
    Tau, Noam
    Klug, Maximiliano
    Konen, Eli
    Marom, Edith Michelle
    EUROPEAN JOURNAL OF RADIOLOGY, 2024, 170
  • [43] Artificial intelligence-aided diagnosis model for acute respiratory distress syndrome combining clinical data and chest radiographs
    Pai, Kai-Chih
    Chao, Wen-Cheng
    Huang, Yu-Len
    Sheu, Ruey-Kai
    Chen, Lun-Chi
    Wang, Min-Shian
    Lin, Shau-Hung
    Yu, Yu-Yi
    Wu, Chieh-Liang
    Chan, Ming-Cheng
    DIGITAL HEALTH, 2022, 8
  • [44] Can computer vision / artificial intelligence locate key reference points and make clinically relevant measurements on axillary radiographs?
    Sheth, Mihir M.
    Matsen III, Frederick A.
    Hsu, Jason E.
    Xie, Kunzhu
    Peng, Yuexiang
    Wu, Weincheng
    Zheng, Bolong
    INTERNATIONAL ORTHOPAEDICS, 2025, 49 (01) : 135 - 141
  • [45] Performance of artificial intelligence-based software for the automatic detection of lung lesions on chest radiographs of patients with suspected lung cancer
    Takamatsu, Atsushi
    Ueno, Midori
    Yoshida, Kotaro
    Kobayashi, Takeshi
    Kobayashi, Satoshi
    Gabata, Toshifumi
    JAPANESE JOURNAL OF RADIOLOGY, 2024, 42 (03) : 291 - 299
  • [46] Artificial Intelligence to Assess Tracheal Tubes and Central Venous Catheters in Chest Radiographs Using an Algorithmic Approach With Adjustable Positioning Definitions
    Rueckel, Johannes
    Huemmer, Christian
    Shahidi, Casra
    Buizza, Giulia
    Hoppe, Boj Friedrich
    Liebig, Thomas
    Ricke, Jens
    Rudolph, Jan
    Sabel, Bastian Oliver
    INVESTIGATIVE RADIOLOGY, 2024, 59 (04) : 306 - 313
  • [47] Multicentre external validation of a commercial artificial intelligence software to analyse chest radiographs in health screening environments with low disease prevalence
    Kim, Cherry
    Yang, Zepa
    Park, Seong Ho
    Hwang, Sung Ho
    Oh, Yu-Whan
    Kang, Eun-Young
    Yong, Hwan Seok
    EUROPEAN RADIOLOGY, 2023, 33 (05) : 3501 - 3509
  • [48] Performance of artificial intelligence-based software for the automatic detection of lung lesions on chest radiographs of patients with suspected lung cancer
    Atsushi Takamatsu
    Midori Ueno
    Kotaro Yoshida
    Takeshi Kobayashi
    Satoshi Kobayashi
    Toshifumi Gabata
    Japanese Journal of Radiology, 2024, 42 : 291 - 299
  • [49] Artificial intelligence improves resident detection of pediatric and young adult upper extremity fractures
    Zech, John R.
    Ezuma, Chimere O.
    Patel, Shreya
    Edwards, Collin R.
    Posner, Russell
    Hannon, Erin
    Williams, Faith
    Lala, Sonali V.
    Ahmad, Zohaib Y.
    Moy, Matthew P.
    Wong, Tony T.
    SKELETAL RADIOLOGY, 2024, 53 (12) : 2643 - 2651
  • [50] Multicentre external validation of a commercial artificial intelligence software to analyse chest radiographs in health screening environments with low disease prevalence
    Cherry Kim
    Zepa Yang
    Seong Ho Park
    Sung Ho Hwang
    Yu-Whan Oh
    Eun-Young Kang
    Hwan Seok Yong
    European Radiology, 2023, 33 : 3501 - 3509