Predicting Major Adverse Cardiovascular Events Following Carotid Endarterectomy Using Machine Learning

被引:15
作者
Li, Ben [1 ,2 ,3 ]
Verma, Raj [4 ]
Beaton, Derek [5 ]
Tamim, Hani [6 ,7 ]
Hussain, Mohamad A. [8 ,9 ]
Hoballah, Jamal J. [10 ]
Lee, Douglas S. [11 ,12 ,13 ]
Wijeysundera, Duminda N. [12 ,13 ,14 ,15 ]
de Mestral, Charles [1 ,12 ,13 ,15 ]
Mamdani, Muhammad [2 ,3 ,5 ,12 ,13 ,15 ,16 ]
Al-Omran, Mohammed [1 ,2 ,3 ,7 ,15 ,17 ]
机构
[1] St Michaels Hosp, Unity Hlth Toronto, Div Vasc Surg, 30 Bond St,Suite 7-074, Toronto, ON M5B 1W8, Canada
[2] Univ Toronto, Inst Med Sci, Toronto, ON, Canada
[3] Univ Toronto, Temerty Ctr Artificial Intelligence Res & Educ Me, Toronto, ON, Canada
[4] Univ Med & Hlth Sci, Royal Coll Surg Ireland, Sch Med, Dublin, Ireland
[5] Univ Toronto, Data Sci & Adv Analyt, Unity Hlth Toronto, Toronto, ON, Canada
[6] Amer Univ Beirut, Med Ctr, Fac Med, Clin Res Inst, Beirut, Lebanon
[7] Alfaisal Univ, Coll Med, Riyadh, Saudi Arabia
[8] Harvard Med Sch, Brigham & Womens Hosp, Div Vasc & Endovasc Surg, Boston, MA USA
[9] Harvard Med Sch, Brigham & Womens Hosp, Ctr Surg & Publ Hlth, Boston, MA USA
[10] Amer Univ Beirut, Med Ctr, Dept Surg, Div Vasc & Endovasc Surg, Beirut, Lebanon
[11] Univ Hlth Network, Div Cardiol, Peter Munk Cardiac Ctr, Toronto, ON, Canada
[12] Univ Toronto, Inst Hlth Policy Management & Evaluat, Toronto, ON, Canada
[13] Univ Toronto, ICES, Toronto, ON, Canada
[14] St Michaels Hosp, Unity Hlth Toronto, Dept Anesthesia, Toronto, ON, Canada
[15] St Michaels Hosp, Unity Hlth Toronto, Li Ka Shing Knowledge Inst, Toronto, ON, Canada
[16] Univ Toronto, Leslie Dan Fac Pharm, Toronto, ON, Canada
[17] King Faisal Specialist Hosp & Res Ctr, Dept Surg, Riyadh, Saudi Arabia
来源
JOURNAL OF THE AMERICAN HEART ASSOCIATION | 2023年 / 12卷 / 20期
基金
加拿大健康研究院;
关键词
carotid endarterectomy; machine learning; major adverse cardiovascular event; prediction; HIGH-RISK; LOGISTIC-REGRESSION; SURGICAL OUTCOMES; NEURAL-NETWORKS; IMPACT; COMPLICATIONS; MEDICARE; XGBOOST;
D O I
10.1161/JAHA.123.030508
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
BACKGROUND: Carotid endarterectomy (CEA) is a major vascular operation for stroke prevention that carries significant perioperative risks; however, outcome prediction tools remain limited. The authors developed machine learning algorithms to predict outcomes following CEA. METHODS AND RESULTS: The National Surgical Quality Improvement Program targeted vascular database was used to identify patients who underwent CEA between 2011 and 2021. Input features included 36 preoperative demographic/clinical variables. The primary outcome was 30-day major adverse cardiovascular events (composite of stroke, myocardial infarction, or death). The data were split into training (70%) and test (30%) sets. Using 10-fold cross-validation, 6 machine learning models were trained using preoperative features. The primary metric for evaluating model performance was area under the receiver operating characteristic curve. Model robustness was evaluated with calibration plot and Brier score. Overall, 38 853 patients underwent CEA during the study period. Thirty-day major adverse cardiovascular events occurred in 1683 (4.3%) patients. The best performing prediction model was XGBoost, achieving an area under the receiver operating characteristic curve of 0.91 (95% CI, 0.90-0.92). In comparison, logistic regression had an area under the receiver operating characteristic curve of 0.62 (95% CI, 0.60-0.64), and existing tools in the literature demonstrate area under the receiver operating characteristic curve values ranging from 0.58 to 0.74. The calibration plot showed good agreement between predicted and observed event probabilities with a Brier score of 0.02. The strongest predictive feature in our algorithm was carotid symptom status. CONCLUSIONS: The machine learning models accurately predicted 30-day outcomes following CEA using preoperative data and performed better than existing tools. They have potential for important utility in guiding risk-mitigation strategies to improve outcomes for patients being considered for CEA.
引用
收藏
页数:11
相关论文
共 46 条
[1]   Society for Vascular Surgery clinical practice guidelines for management of extracranial cerebrovascular disease [J].
AbuRahma, Ali F. ;
Avgerinos, Efthymios D. ;
Chang, Robert W. ;
Darling, R. Clement, III ;
Duncan, Audra A. ;
Forbes, Thomas L. ;
Malas, Mahmoud B. ;
Murad, Mohammad Hassan ;
Perler, Bruce Alan ;
Powell, Richard J. ;
Rockman, Caron B. ;
Zhou, Wei .
JOURNAL OF VASCULAR SURGERY, 2022, 75 (01) :4S-22S
[2]  
Bastanlar Y, 2014, METHODS MOL BIOL, V1107, P105, DOI 10.1007/978-1-62703-748-8_7
[3]   The use of Big Data Analytics in healthcare [J].
Batko, Kornelia ;
Slezak, Andrzej .
JOURNAL OF BIG DATA, 2022, 9 (01)
[4]   Development and Evaluation of the Universal ACS NSQIP Surgical Risk Calculator: A Decision Aid and Informed Consent Tool for Patients and Surgeons [J].
Bilimoria, Karl Y. ;
Liu, Yaoming ;
Paruch, Jennifer L. ;
Zhou, Lynn ;
Kmiecik, Thomas E. ;
Ko, Clifford Y. ;
Cohen, Mark E. .
JOURNAL OF THE AMERICAN COLLEGE OF SURGEONS, 2013, 217 (05) :833-+
[5]   Assessing the utility of deep neural networks in predicting postoperative surgical complications: a retrospective study [J].
Bonde, Alexander ;
Varadarajan, Kartik M. ;
Bonde, Nicholas ;
Troelsen, Anders ;
Muratoglu, Orhun K. ;
Malchau, Henrik ;
Yang, Anthony D. ;
Alam, Hasan ;
Sillesen, Martin .
LANCET DIGITAL HEALTH, 2021, 3 (08) :E471-E485
[6]   XGBoost: A Scalable Tree Boosting System [J].
Chen, Tianqi ;
Guestrin, Carlos .
KDD'16: PROCEEDINGS OF THE 22ND ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2016, :785-794
[7]  
Collins GS, 2015, ANN INTERN MED, V162, P55, DOI [10.7326/M14-0697, 10.1111/eci.12376, 10.1186/s12916-014-0241-z, 10.1136/bmj.g7594, 10.1016/j.jclinepi.2014.11.010, 10.7326/M14-0698, 10.1016/j.eururo.2014.11.025, 10.1002/bjs.9736, 10.1038/bjc.2014.639]
[8]   Predictive Score of Adverse Events After Carotid Endarterectomy: The NSQIP Registry Carotid Endarterectomy Scale [J].
Dasenbrock, Hormuzdiyar H. ;
Smith, Timothy R. ;
Gormley, William B. ;
Castlen, Joseph P. ;
Patel, Nirav J. ;
Frerichs, Kai U. ;
Aziz-Sultan, Ali ;
Du, Rose .
JOURNAL OF THE AMERICAN HEART ASSOCIATION, 2019, 8 (21)
[9]   The Clinical Impact of Cardiology Consultation Prior to Major Vascular Surgery [J].
Davis, Frank M. ;
Park, Yeo June ;
Grey, Scott F. ;
Boniakowski, Anna E. ;
Mansour, M. Ashraf ;
Jain, Krishna M. ;
Nypaver, Timothy ;
Grossman, Michael ;
Gurm, Hitinder ;
Henke, Peter K. .
ANNALS OF SURGERY, 2018, 267 (01) :189-195
[10]   COMPARING THE AREAS UNDER 2 OR MORE CORRELATED RECEIVER OPERATING CHARACTERISTIC CURVES - A NONPARAMETRIC APPROACH [J].
DELONG, ER ;
DELONG, DM ;
CLARKEPEARSON, DI .
BIOMETRICS, 1988, 44 (03) :837-845