Outcome Prediction in Critically-Ill Patients with Venous Thromboembolism and/or Cancer Using Machine Learning Algorithms: External Validation and Comparison with Scoring Systems

被引:16
作者
Danilatou, Vasiliki [1 ,2 ]
Nikolakakis, Stylianos [3 ]
Antonakaki, Despoina [4 ]
Tzagkarakis, Christos [4 ]
Mavroidis, Dimitrios [4 ]
Kostoulas, Theodoros [5 ]
Ioannidis, Sotirios [3 ,4 ]
机构
[1] Sphynx Technol Solut, CH-6300 Zug, Switzerland
[2] European Univ Cyprus, Sch Med, CY-2404 Nicosia, Cyprus
[3] Tech Univ Crete, Sch Elect & Comp Engn, Khania 73100, Greece
[4] Fdn Res & Technol Hellas FORTH, Inst Comp Sci ICS, Iraklion 70013, Greece
[5] Univ Aegean, Sch Engn, Dept Informat & Commun Syst Engn, Samos 83200, Greece
基金
欧盟地平线“2020”;
关键词
venous thromboembolism; cancer; mortality; ICU; interpretable machine learning; INTENSIVE-CARE-UNIT; CLINICAL PROGNOSTIC MODEL; MORTALITY PREDICTION; PULMONARY-EMBOLISM;
D O I
10.3390/ijms23137132
中图分类号
Q5 [生物化学]; Q7 [分子生物学];
学科分类号
071010 ; 081704 ;
摘要
Intensive care unit (ICU) patients with venous thromboembolism (VTE) and/or cancer suffer from high mortality rates. Mortality prediction in the ICU has been a major medical challenge for which several scoring systems exist but lack in specificity. This study focuses on two target groups, namely patients with thrombosis or cancer. The main goal is to develop and validate interpretable machine learning (ML) models to predict early and late mortality, while exploiting all available data stored in the medical record. To this end, retrospective data from two freely accessible databases, MIMIC-III and eICU, were used. Well-established ML algorithms were implemented utilizing automated and purposely built ML frameworks for addressing class imbalance. Prediction of early mortality showed excellent performance in both disease categories, in terms of the area under the receiver operating characteristic curve (AUC-ROC): VTE-MIMIC-III 0.93, eICU 0.87, cancer-MIMIC-III 0.94. On the other hand, late mortality prediction showed lower performance, i.e., AUC-ROC: VTE 0.82, cancer 0.74-0.88. The predictive model of early mortality developed from 1651 VTE patients (MIMIC-III) ended up with a signature of 35 features and was externally validated in 2659 patients from the eICU dataset. Our model outperformed traditional scoring systems in predicting early as well as late mortality. Novel biomarkers, such as red cell distribution width, were identified.
引用
收藏
页数:25
相关论文
共 65 条
[1]  
ahrq, Clinical Classifications Software Refined (CCSR) for ICD-10-CM Diagnoses
[2]   An Approach Based on Mutually Informed Neural Networks to Optimize the Generalization Capabilities of Decision Support Systems Developed for Heart Failure Prediction [J].
Ali, L. ;
Bukhari, S. A. C. .
IRBM, 2021, 42 (05) :345-352
[3]  
[Anonymous], 2022, BADER LAB SABER SEQU
[4]   Blood Urea Nitrogen (BUN) is independently associated with mortality in critically ill patients admitted to ICU [J].
Arihan, Okan ;
Wernly, Bernhard ;
Lichtenauer, Michael ;
Franz, Marcus ;
Kabisch, Bjoern ;
Muessig, Johanna ;
Masyuk, Maryna ;
Lauten, Alexander ;
Schulze, Paul Christian ;
Hoppe, Uta C. ;
Kelm, Malte ;
Jung, Christian .
PLOS ONE, 2018, 13 (01)
[5]   Validation of a clinical prognostic model to identify low-risk patients with pulmonary embolism [J].
Aujesky, D. ;
Perrier, A. ;
Roy, P.-M. ;
Stone, R. A. ;
Cornuz, J. ;
Meyer, G. ;
Obrosky, D. S. ;
Fine, M. J. .
JOURNAL OF INTERNAL MEDICINE, 2007, 261 (06) :597-604
[6]   Validation of a model to predict adverse outcomes in patients with pulmonary embolism [J].
Aujesky, D ;
Roy, PM ;
Le Manach, CP ;
Verschuren, F ;
Meyer, G ;
Obrosky, DS ;
Stone, RA ;
Cornuz, J ;
Fine, MJ .
EUROPEAN HEART JOURNAL, 2006, 27 (04) :476-481
[7]   Incidence of thromboembolism in patients with COVID-19: a systematic review and meta-analysis [J].
Boonyawat, Kochawan ;
Chantrathammachart, Pichika ;
Numthavej, Pawin ;
Nanthatanti, Nithita ;
Phusanti, Sithakom ;
Phuphuakrat, Angsana ;
Niparuck, Pimjai ;
Angchaisuksiri, Pantep .
THROMBOSIS JOURNAL, 2020, 18 (01)
[8]   The use of the area under the roc curve in the evaluation of machine learning algorithms [J].
Bradley, AP .
PATTERN RECOGNITION, 1997, 30 (07) :1145-1159
[9]   Diagnosis related groups in Europe: moving towards transparency, efficiency, and quality in hospitals? [J].
Busse, Reinhard ;
Geissler, Alexander ;
Aaviksoo, Ain ;
Cots, Francesc ;
Hakkinen, Unto ;
Kobel, Conrad ;
Mateus, Ceu ;
Or, Zeynep ;
O'Reilly, Jacqueline ;
Serden, Lisbeth ;
Street, Andrew ;
Tan, Siok Swan ;
Quentin, Wilm .
BMJ-BRITISH MEDICAL JOURNAL, 2013, 346
[10]   SMOTE: Synthetic minority over-sampling technique [J].
Chawla, Nitesh V. ;
Bowyer, Kevin W. ;
Hall, Lawrence O. ;
Kegelmeyer, W. Philip .
2002, American Association for Artificial Intelligence (16)