Outcome Prediction in Critically-Ill Patients with Venous Thromboembolism and/or Cancer Using Machine Learning Algorithms: External Validation and Comparison with Scoring Systems

被引:14
作者
Danilatou, Vasiliki [1 ,2 ]
Nikolakakis, Stylianos [3 ]
Antonakaki, Despoina [4 ]
Tzagkarakis, Christos [4 ]
Mavroidis, Dimitrios [4 ]
Kostoulas, Theodoros [5 ]
Ioannidis, Sotirios [3 ,4 ]
机构
[1] Sphynx Technol Solut, CH-6300 Zug, Switzerland
[2] European Univ Cyprus, Sch Med, CY-2404 Nicosia, Cyprus
[3] Tech Univ Crete, Sch Elect & Comp Engn, Khania 73100, Greece
[4] Fdn Res & Technol Hellas FORTH, Inst Comp Sci ICS, Iraklion 70013, Greece
[5] Univ Aegean, Sch Engn, Dept Informat & Commun Syst Engn, Samos 83200, Greece
基金
欧盟地平线“2020”;
关键词
venous thromboembolism; cancer; mortality; ICU; interpretable machine learning; INTENSIVE-CARE-UNIT; CLINICAL PROGNOSTIC MODEL; MORTALITY PREDICTION; PULMONARY-EMBOLISM;
D O I
10.3390/ijms23137132
中图分类号
Q5 [生物化学]; Q7 [分子生物学];
学科分类号
071010 ; 081704 ;
摘要
Intensive care unit (ICU) patients with venous thromboembolism (VTE) and/or cancer suffer from high mortality rates. Mortality prediction in the ICU has been a major medical challenge for which several scoring systems exist but lack in specificity. This study focuses on two target groups, namely patients with thrombosis or cancer. The main goal is to develop and validate interpretable machine learning (ML) models to predict early and late mortality, while exploiting all available data stored in the medical record. To this end, retrospective data from two freely accessible databases, MIMIC-III and eICU, were used. Well-established ML algorithms were implemented utilizing automated and purposely built ML frameworks for addressing class imbalance. Prediction of early mortality showed excellent performance in both disease categories, in terms of the area under the receiver operating characteristic curve (AUC-ROC): VTE-MIMIC-III 0.93, eICU 0.87, cancer-MIMIC-III 0.94. On the other hand, late mortality prediction showed lower performance, i.e., AUC-ROC: VTE 0.82, cancer 0.74-0.88. The predictive model of early mortality developed from 1651 VTE patients (MIMIC-III) ended up with a signature of 35 features and was externally validated in 2659 patients from the eICU dataset. Our model outperformed traditional scoring systems in predicting early as well as late mortality. Novel biomarkers, such as red cell distribution width, were identified.
引用
收藏
页数:25
相关论文
共 65 条
  • [1] AHRQ, Clinical Classifications Software Refined (CCSR)
  • [2] An Approach Based on Mutually Informed Neural Networks to Optimize the Generalization Capabilities of Decision Support Systems Developed for Heart Failure Prediction
    Ali, L.
    Bukhari, S. A. C.
    [J]. IRBM, 2021, 42 (05) : 345 - 352
  • [3] [Anonymous], 2022, BADER LAB SABER SEQU
  • [4] Blood Urea Nitrogen (BUN) is independently associated with mortality in critically ill patients admitted to ICU
    Arihan, Okan
    Wernly, Bernhard
    Lichtenauer, Michael
    Franz, Marcus
    Kabisch, Bjoern
    Muessig, Johanna
    Masyuk, Maryna
    Lauten, Alexander
    Schulze, Paul Christian
    Hoppe, Uta C.
    Kelm, Malte
    Jung, Christian
    [J]. PLOS ONE, 2018, 13 (01):
  • [5] Validation of a clinical prognostic model to identify low-risk patients with pulmonary embolism
    Aujesky, D.
    Perrier, A.
    Roy, P.-M.
    Stone, R. A.
    Cornuz, J.
    Meyer, G.
    Obrosky, D. S.
    Fine, M. J.
    [J]. JOURNAL OF INTERNAL MEDICINE, 2007, 261 (06) : 597 - 604
  • [6] Validation of a model to predict adverse outcomes in patients with pulmonary embolism
    Aujesky, D
    Roy, PM
    Le Manach, CP
    Verschuren, F
    Meyer, G
    Obrosky, DS
    Stone, RA
    Cornuz, J
    Fine, MJ
    [J]. EUROPEAN HEART JOURNAL, 2006, 27 (04) : 476 - 481
  • [7] Boonyawat K, 2020, THROMB J, V18, DOI 10.1186/s12959-020-00248-5
  • [8] The use of the area under the roc curve in the evaluation of machine learning algorithms
    Bradley, AP
    [J]. PATTERN RECOGNITION, 1997, 30 (07) : 1145 - 1159
  • [9] Diagnosis related groups in Europe: moving towards transparency, efficiency, and quality in hospitals?
    Busse, Reinhard
    Geissler, Alexander
    Aaviksoo, Ain
    Cots, Francesc
    Hakkinen, Unto
    Kobel, Conrad
    Mateus, Ceu
    Or, Zeynep
    O'Reilly, Jacqueline
    Serden, Lisbeth
    Street, Andrew
    Tan, Siok Swan
    Quentin, Wilm
    [J]. BMJ-BRITISH MEDICAL JOURNAL, 2013, 346
  • [10] SMOTE: Synthetic minority over-sampling technique
    Chawla, Nitesh V.
    Bowyer, Kevin W.
    Hall, Lawrence O.
    Kegelmeyer, W. Philip
    [J]. 2002, American Association for Artificial Intelligence (16)