Logistic regression was as good as machine learning for predicting major chronic diseases

被引:289
作者
Nusinovici, Simon [1 ]
Tham, Yih Chung [1 ,3 ]
Yan, Marco Yu Chak [1 ]
Ting, Daniel Shu Wei [1 ,3 ]
Li, Jialiang [1 ,4 ]
Sabanayagam, Charumathi [1 ,3 ]
Wong, Tien Yin [1 ,2 ,3 ]
Cheng, Ching-Yu [1 ,2 ,3 ]
机构
[1] Singapore Natl Eye Ctr, Singapore Eye Res Inst, Singapore, Singapore
[2] Natl Univ Singapore, Yong Loo Lin Sch Med, Dept Ophthalmol, Singapore, Singapore
[3] Duke NUS Med Sch, Ophthalmol & Visual Sci Acad Clin Programme, Singapore, Singapore
[4] Natl Univ Singapore, Dept Stat & Appl Probabil, Singapore, Singapore
基金
英国医学研究理事会;
关键词
Machine learning; Logistic regression; Prognostic modeling; Chronic diseases; Interaction; Nonlinearity; SINGAPORE MALAY EYE; CONVENTIONAL REGRESSION; CARDIOVASCULAR-DISEASE; RISK PREDICTION; METHODOLOGY; CLASSIFICATION; RATIONALE; PROGNOSIS; MORTALITY; DIAGNOSIS;
D O I
10.1016/j.jclinepi.2020.03.002
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Objective: To evaluate the performance of machine learning (ML) algorithms and to compare them with logistic regression for the prediction of risk of cardiovascular diseases (CVDs), chronic kidney disease (CKD), diabetes (DM), and hypertension (HTN) and in a prospective cohort study using simple clinical predictors. Study Design and Setting: We conducted analyses in a population-based cohort study in Asian adults (n = 6,762). Five different ML models were considered-single-hidden-layer neural network, support vector machine, random forest, gradient boosting machine, and k-nearest neighbor-and were compared with standard logistic regression. Results: The incidences at 6 years of CVD, CKD, DM, and HTN cases were 4.0%, 7.0%, 9.2%, and 34.6%, respectively. Logistic regression reached the highest area under the receiver operating characteristic curve for CKD (0.905 [0.88, 0.93]) and DM (0.768 [0.73, 0.81]) predictions. For CVD and HTN, the best models were neural network (0.753 [0.70, 0.81]) and support vector machine (0.780 [0.747, 0.812]), respectively. However, the differences with logistic regression were small (less than 1%) and nonsignificant. Logistic regression, gradient boosting machine, and neural network were systematically ranked among the best models. Conclusion: Logistic regression yields as good performance as ML models to predict the risk of major chronic diseases with low incidence and simple clinical predictors. (C) 2020 Elsevier Inc. All rights reserved.
引用
收藏
页码:56 / 69
页数:14
相关论文
共 50 条
[1]  
[Anonymous], OVER FITTING MODEL T
[2]   Using methods from the data-mining and machine-learning literature for disease classification and prediction: a case study examining classification of heart failure subtypes [J].
Austin, Peter C. ;
Tu, Jack V. ;
Ho, Jennifer E. ;
Levy, Daniel ;
Lee, Douglas S. .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2013, 66 (04) :398-407
[3]  
Batuwita R., 2013, Class imbalance learning methods for support vector machines
[4]   Multi-ethnic study of atherosclerosis: Objectives and design [J].
Bild, DE ;
Bluemke, DA ;
Burke, GL ;
Detrano, R ;
Roux, AVD ;
Folsom, AR ;
Greenland, P ;
Jacobs, DR ;
Kronmal, R ;
Liu, K ;
Nelson, JC ;
O'Leary, D ;
Saad, MF ;
Shea, S ;
Szklo, M ;
Tracy, RP .
AMERICAN JOURNAL OF EPIDEMIOLOGY, 2002, 156 (09) :871-881
[5]   Reporting and Methods in Clinical Prediction Research: A Systematic Review [J].
Bouwmeester, Walter ;
Zuithoff, Nicolaas P. A. ;
Mallett, Susan ;
Geerlings, Mirjam I. ;
Vergouwe, Yvonne ;
Steyerberg, Ewout W. ;
Altman, Douglas G. ;
Moons, Karel G. M. .
PLOS MEDICINE, 2012, 9 (05)
[6]  
Breiman L., 2001, IEEE Trans. Broadcast., V45, P5
[7]   SMOTE: Synthetic minority over-sampling technique [J].
Chawla, Nitesh V. ;
Bowyer, Kevin W. ;
Hall, Lawrence O. ;
Kegelmeyer, W. Philip .
2002, American Association for Artificial Intelligence (16)
[8]   Screening for Prediabetes Using Machine Learning Models [J].
Choi, Soo Beom ;
Kim, Won Jae ;
Yoo, Tae Keun ;
Park, Jee Soo ;
Chung, Jai Won ;
Lee, Yong-ho ;
Kang, Eun Seok ;
Kim, Deok Won .
COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2014, 2014
[9]   A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models [J].
Christodoulou, Evangelia ;
Ma, Jie ;
Collins, Gary S. ;
Steyerberg, Ewout W. ;
Verbakel, Jan Y. ;
Van Calster, Ben .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2019, 110 :12-22
[10]   Multicenter Comparison of Machine Learning Methods and Conventional Regression for Predicting Clinical Deterioration on the Wards [J].
Churpek, Matthew M. ;
Yuen, Trevor C. ;
Winslow, Christopher ;
Meltzer, David O. ;
Kattan, Michael W. ;
Edelson, Dana P. .
CRITICAL CARE MEDICINE, 2016, 44 (02) :368-374