Functional Outcome Prediction in Ischemic Stroke: A Comparison of Machine Learning Algorithms and Regression Models

被引:42
作者
Alaka, Shakiru A. [1 ]
Menon, Bijoy K. [1 ,2 ,3 ]
Brobbey, Anita [1 ]
Williamson, Tyler [1 ]
Goyal, Mayank [2 ,3 ]
Demchuk, Andrew M. [2 ]
Hill, Michael D. [1 ,2 ,3 ]
Sajobi, Tolulope T. [1 ,2 ]
机构
[1] Univ Calgary, OBrien Inst Publ Hlth, Dept Community Hlth Sci, Calgary, AB, Canada
[2] Univ Calgary, Hotchkiss Brain Inst, Dept Clin Neurosci, Calgary, AB, Canada
[3] Univ Calgary, Dept Radiol, Calgary, AB, Canada
来源
FRONTIERS IN NEUROLOGY | 2020年 / 11卷
关键词
machine learning; acute ischemic stroke; functional outcome; clinical risk prediction; discrimination calibration; BASE-LINE; CLASSIFICATION; SCORE;
D O I
10.3389/fneur.2020.00889
中图分类号
R74 [神经病学与精神病学];
学科分类号
摘要
Background and Purpose:Stroke-related functional risk scores are used to predict patients' functional outcomes following a stroke event. We evaluate the predictive accuracy of machine-learning algorithms for predicting functional outcomes in acute ischemic stroke patients after endovascular treatment. Methods:Data were from the Precise and Rapid Assessment of Collaterals with Multi-phase CT Angiography (PROVE-IT), an observational study of 614 ischemic stroke patients. Regression and machine learning models, including random forest (RF), classification and regression tree (CART), C5.0 decision tree (DT), support vector machine (SVM), adaptive boost machine (ABM), least absolute shrinkage and selection operator (LASSO) logistic regression, and logistic regression models were used to train and predict the 90-day functional impairment risk, which is measured by the modified Rankin scale (mRS) score > 2. The models were internally validated using split-sample cross-validation and externally validated in the INTERRSeCT cohort study. The accuracy of these models was evaluated using the area under the receiver operating characteristic curve (AUC), Matthews Correlation Coefficient (MCC), and Brier score. Results:Of the 614 patients included in the training data, 249 (40.5%) had 90-day functional impairment (i.e., mRS > 2). The median and interquartile range (IQR) of age and baseline NIHSS scores were 77 years (IQR = 69-83) and 17 (IQR = 11-22), respectively. Both logistic regression and machine learning models had comparable predictive accuracy when validated internally (AUC range = [0.65-0.72]; MCC range = [0.29-0.42]) and externally (AUC range = [0.66-0.71]; MCC range = [0.34-0.42]). Conclusions:Machine learning algorithms and logistic regression had comparable predictive accuracy for predicting stroke-related functional impairment in stroke patients.
引用
收藏
页数:9
相关论文
共 36 条
[1]  
Abu-Hanna A, 2001, METHOD INFORM MED, V40, P1
[2]  
Al-Ajlan FS, 2017, NEUROVASC IMAGING, V2, DOI DOI 10.1186/s40809-017-0026-9
[3]  
Alfaro E, 2013, J STAT SOFTW, V54, P1
[4]   The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation [J].
Chicco, Davide ;
Jurman, Giuseppe .
BMC GENOMICS, 2020, 21 (01)
[5]   A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models [J].
Christodoulou, Evangelia ;
Ma, Jie ;
Collins, Gary S. ;
Steyerberg, Ewout W. ;
Verbakel, Jan Y. ;
Van Calster, Ben .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2019, 110 :12-22
[6]   Clinical prediction models for mortality and functional outcome following ischemic stroke: A systematic review and meta-analysis [J].
Fahey, Marion ;
Crayton, Elise ;
Wolfe, Charles ;
Douiri, Abdel .
PLOS ONE, 2018, 13 (01)
[7]   Predicting Long-Term Outcome after Endovascular Stroke Treatment: The Totaled Health Risks in Vascular Events Score [J].
Flint, A. C. ;
Cullen, S. P. ;
Faigeles, B. S. ;
Rao, V. A. .
AMERICAN JOURNAL OF NEURORADIOLOGY, 2010, 31 (07) :1192-1196
[8]   R and the Journal of Statistical Software [J].
Fox, John ;
Leanage, Allison .
Journal of Statistical Software, 2016, 73 (02)
[9]   Regularization Paths for Generalized Linear Models via Coordinate Descent [J].
Friedman, Jerome ;
Hastie, Trevor ;
Tibshirani, Rob .
JOURNAL OF STATISTICAL SOFTWARE, 2010, 33 (01) :1-22
[10]   Goldenhar Syndrome Associated with Contralateral Agenesis of the Internal Carotid Artery [J].
Ventura, Elisa ;
Ormitti, Francesca ;
Crisi, Girolamo ;
Sesenna, Enrico .
NEURORADIOLOGY JOURNAL, 2014, 27 (02) :150-153