Mortality Prediction of COVID-19 Patients Using Radiomic and Neural Network Features Extracted from a Wide Chest X-ray Sample Size: A Robust Approach for Different Medical Imbalanced Scenarios

被引:11
作者
Iori, Mauro [1 ]
Di Castelnuovo, Carlo [1 ]
Verzellesi, Laura [2 ]
Meglioli, Greta [1 ]
Lippolis, Davide Giosue [1 ]
Nitrosi, Andrea [1 ]
Monelli, Filippo [3 ,4 ]
Besutti, Giulia [3 ]
Trojani, Valeria [1 ]
Bertolini, Marco [1 ]
Botti, Andrea [1 ]
Castellani, Gastone [5 ]
Remondini, Daniel [2 ,6 ]
Sghedoni, Roberto [1 ]
Croci, Stefania [7 ]
Salvarani, Carlo [8 ,9 ]
机构
[1] Azienda USL IRCCS Reggio Emilia, Med Phys Unit, I-42123 Reggio Emilia, Italy
[2] Univ Bologna, Dept Phys & Astron DIFA, I-40126 Bologna, Italy
[3] Azienda USL IRCCS Reggio Emilia, Radiol Unit, I-42123 Reggio Emilia, Italy
[4] Univ Modena & Reggio Emilia, Clin & Expt Med PhD Program, I-41121 Modena, Italy
[5] Dept Expt Diagnost & Specialty Med DIMES, I-40126 Bologna, Italy
[6] Ist Nazl Fis Nucl INFN, I-40127 Bologna, Italy
[7] Azienda USL IRCCS Reggio Emilia, Clin Immunol Allergy & Adv Biotechnol Unit, I-42123 Reggio Emilia, Italy
[8] Azienda USL IRCCS Reggio Emilia, Rheumatol Unit, I-42123 Reggio Emilia, Italy
[9] Univ Modena & Reggio Emilia, Rheumatol Div, I-41121 Modena, Italy
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 08期
关键词
machine learning; radiomics; COVID-19; X-ray radiography; under-sampling; ARTIFICIAL-INTELLIGENCE;
D O I
10.3390/app12083903
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Aim: The aim of this study was to develop robust prognostic models for mortality prediction of COVID-19 patients, applicable to different sets of real scenarios, using radiomic and neural network features extracted from chest X-rays (CXRs) with a certified and commercially available software. Methods: 1816 patients from 5 different hospitals in the Province of Reggio Emilia were included in the study. Overall, 201 radiomic features and 16 neural network features were extracted from each COVID-19 patient's radiography. The initial dataset was balanced to train the classifiers with the same number of dead and survived patients, randomly selected. The pipeline had three main parts: balancing procedure; three-step feature selection; and mortality prediction with radiomic features through three machine learning (ML) classification models: AdaBoost (ADA), Quadratic Discriminant Analysis (QDA) and Random Forest (RF). Five evaluation metrics were computed on the test samples. The performance for death prediction was validated on both a balanced dataset (Case 1) and an imbalanced dataset (Case 2). Results: accuracy (ACC), area under the ROC-curve (AUC) and sensitivity (SENS) for the best classifier were, respectively, 0.72 +/- 0.01, 0.82 +/- 0.02 and 0.84 +/- 0.04 for Case 1 and 0.70 +/- 0.04, 0.79 +/- 0.03 and 0.76 +/- 0.06 for Case 2. These results show that the prediction of COVID-19 mortality is robust in a different set of scenarios. Conclusions: Our large and varied dataset made it possible to train ML algorithms to predict COVID-19 mortality using radiomic and neural network features of CXRs.
引用
收藏
页数:13
相关论文
共 55 条
  • [1] Ahmed S, 2020, RECONET MULTILEVEL P
  • [2] Radiomics machine learning study with a small sample size: Single random training-test set split may lead to unreliable results
    An, Chansik
    Park, Yae Won
    Ahn, Sung Soo
    Han, Kyunghwa
    Kim, Hwiyoung
    Lee, Seung-Koo
    [J]. PLOS ONE, 2021, 16 (08):
  • [3] Machine learning prediction for mortality of patients diagnosed with COVID-19: a nationwide Korean cohort study
    An, Chansik
    Lim, Hyunsun
    Kim, Dong-Wook
    Chang, Jung Hyun
    Choi, Yoon Jung
    Kim, Seong Woo
    [J]. SCIENTIFIC REPORTS, 2020, 10 (01)
  • [4] Outcomes from intensive care in patients with COVID-19: a systematic review and meta-analysis of observational studies
    Armstrong, R. A.
    Kane, A. D.
    Cook, T. M.
    [J]. ANAESTHESIA, 2020, 75 (10) : 1340 - 1349
  • [5] Artificial Intelligence and the Medical Physicist: Welcome to the Machine
    Avanzo, Michele
    Trianni, Annalisa
    Botta, Francesca
    Talamonti, Cinzia
    Stasi, Michele
    Iori, Mauro
    [J]. APPLIED SCIENCES-BASEL, 2021, 11 (04): : 1 - 17
  • [6] A Novel Bayesian Optimization-Based Machine Learning Framework for COVID-19 Detection From Inpatient Facility Data
    Awal, Md. Abdul
    Masud, Mehedi
    Hossain, Md. Shahadat
    Bulbul, Abdullah Al-Mamun
    Mahmud, S. M. Hasan
    Bairagi, Anupam Kumar
    [J]. IEEE ACCESS, 2021, 9 : 10263 - 10281
  • [7] Predicting Mechanical Ventilation and Mortality in COVID-19 Using Radiomics and Deep Learning on Chest Radiographs: A Multi-Institutional Study
    Bae, Joseph
    Kapse, Saarthak
    Singh, Gagandeep
    Gattu, Rishabh
    Ali, Syed
    Shah, Neal
    Marshall, Colin
    Pierce, Jonathan
    Phatak, Tej
    Gupta, Amit
    Green, Jeremy
    Madan, Nikhil
    Prasanna, Prateek
    [J]. DIAGNOSTICS, 2021, 11 (10)
  • [8] Predicting cancer outcomes with radiomics and artificial intelligence in radiology
    Bera, Kaustav
    Braman, Nathaniel
    Gupta, Amit
    Velcheti, Vamsidhar
    Madabhushi, Anant
    [J]. NATURE REVIEWS CLINICAL ONCOLOGY, 2022, 19 (02) : 132 - 146
  • [9] COVID Mortality Prediction with Machine Learning Methods: A Systematic Review and Critical Appraisal
    Bottino, Francesca
    Tagliente, Emanuela
    Pasquini, Luca
    Di Napoli, Alberto
    Lucignani, Martina
    Figa-Talamanca, Lorenzo
    Napolitano, Antonio
    [J]. JOURNAL OF PERSONALIZED MEDICINE, 2021, 11 (09):
  • [10] Introducing the GEV Activation Function for Highly Unbalanced Data to Develop COVID-19 Diagnostic Models
    Bridge, Joshua
    Meng, Yanda
    Zhao, Yitian
    Du, Yong
    Zhao, Mingfeng
    Sun, Renrong
    Zheng, Yalin
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (10) : 2776 - 2786