RETRACTED: Clinical Value of Predicting Individual Treatment Effects for Intensive Blood Pressure Therapy A Machine Learning Experiment to Estimate Treatment Effects from Randomized Trial Data (Retracted Article)

被引:34
作者
Duan, Tony [1 ]
Rajpurkar, Pranav [1 ]
Laird, Dillon [1 ]
Ng, Andrew Y. [1 ]
Basu, Sanjay [2 ,3 ,4 ,5 ]
机构
[1] Stanford Univ, Dept Comp Sci, Stanford, CA 94305 USA
[2] Stanford Univ, Ctr Primary Care & Outcomes Res, Dept Med, Stanford, CA 94305 USA
[3] Stanford Univ, Ctr Primary Care & Outcomes Res, Dept Hlth Res & Policy, Stanford, CA 94305 USA
[4] Stanford Univ, Dept Med, Ctr Populat Hlth Sci, Stanford, CA 94305 USA
[5] Stanford Univ, Ctr Populat Hlth Sci, Dept Hlth Res & Policy, Stanford, CA 94305 USA
来源
CIRCULATION-CARDIOVASCULAR QUALITY AND OUTCOMES | 2019年 / 12卷 / 03期
基金
美国国家卫生研究院;
关键词
blood pressure; cardiovascular disease; calibration; machine learning; risk factors; CARDIOVASCULAR RISK; INVERSE PROBABILITY; BENEFIT;
D O I
10.1161/CIRCOUTCOMES.118.005010
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
BACKGROUND: The absolute risk reduction (ARR) in cardiovascular events from therapy is generally assumed to be proportional to baseline risk-such that high-risk patients benefit most. Yet newer analyses have proposed using randomized trial data to develop models that estimate individual treatment effects. We tested 2 hypotheses: first, that models of individual treatment effects would reveal that benefit from intensive blood pressure therapy is proportional to baseline risk; and second, that a machine learning approach designed to predict heterogeneous treatment effects-the X-learner meta-algorithm-is equivalent to a conventional logistic regression approach. METHODS AND RESULTS: We compared conventional logistic regression to the X-learner approach for prediction of 3-year cardiovascular disease event risk reduction from intensive (target systolic blood pressure <120 mm Hg) versus standard (target <140 mm Hg) blood pressure treatment, using individual participant data from the SPRINT (Systolic Blood Pressure Intervention Trial; N=9361) and ACCORD BP (Action to Control Cardiovascular Risk in Diabetes Blood Pressure; N=4733) trials. Each model incorporated 17 covariates, an indicator for treatment arm, and interaction terms between covariates and treatment. Logistic regression had lower C statistic for benefit than the X-learner (0.51 [95% CI, 0.49-0.53] versus 0.60 [95% CI, 0.58-0.63], respectively). Following the logistic regression's recommendation for individualized therapy produced restricted mean time until cardiovascular disease event of 1065.47 days (95% CI, 1061.04-1069.35), while following the X-learner's recommendation improved mean time until cardiovascular disease event to 1068.71 days (95% CI, 1065.42-1072.08). Calibration was worse for logistic regression; it overestimated ARR attributable to intensive treatment (slope between predicted and observed ARR of 0.73 [95% CI, 0.30-1.14] versus 1.06 [95% CI, 0.74-1.32] for the X-learner, compared with the ideal of 1). Predicted ARRs using logistic regression were generally proportional to baseline pretreatment cardiovascular risk, whereas the X-learner observed-correctly-that individual treatment effects were often not proportional to baseline risk. CONCLUSIONS: Predictions for individual treatment effects from trial data reveal that patients may experience ARRs not simply proportional to baseline cardiovascular disease risk. Machine learning methods may improve discrimination and calibration of individualized treatment effect estimates from clinical trial data.
引用
收藏
页数:10
相关论文
共 31 条
[1]   Recursive partitioning for heterogeneous causal effects [J].
Athey, Susan ;
Imbens, Guido .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2016, 113 (27) :7353-7360
[2]   Benefit and harm of intensive blood pressure treatment: Derivation and validation of risk models using data from the SPRINT and ACCORD trials [J].
Basu, Sanjay ;
Sussman, Jeremy B. ;
Rigdon, Joseph ;
Steimle, Lauren ;
Denton, Brian T. ;
Hayward, Rodney A. .
PLOS MEDICINE, 2017, 14 (10)
[3]   Targeting weight loss interventions to reduce cardiovascular complications of type 2 diabetes: a machine learning-based post-hoc analysis of heterogeneous treatment effects in the Look AHEAD trial [J].
Baum, Aaron ;
Scarpa, Joseph ;
Bruzelius, Emilie ;
Tamler, Ronald ;
Basu, Sanjay ;
Faghmous, James .
LANCET DIABETES & ENDOCRINOLOGY, 2017, 5 (10) :808-815
[4]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[5]   Using Internally Developed Risk Models to Assess Heterogeneity in Treatment Effects in Clinical Trials [J].
Burke, James F. ;
Hayward, Rodney A. ;
Nelson, Jason P. ;
Kent, David M. .
CIRCULATION-CARDIOVASCULAR QUALITY AND OUTCOMES, 2014, 7 (01) :163-169
[6]   Potential Application of Machine Learning in Health Outcomes Research and Some Statistical Cautions [J].
Crown, William H. .
VALUE IN HEALTH, 2015, 18 (02) :137-140
[7]   Effects of Intensive Blood-Pressure Control in Type 2 Diabetes Mellitus [J].
Cushman, William C. ;
Evans, Gregory W. ;
Byington, Robert P. ;
Goff, David C., Jr. ;
Grimm, Richard H., Jr. ;
Cutler, Jeffrey A. ;
Simons-Morton, Denise G. ;
Basile, Jan N. ;
Corson, Marshall A. ;
Probstfield, Jeffrey L. ;
Katz, Lois ;
Peterson, Kevin A. ;
Friedewald, William T. ;
Buse, John B. ;
Bigger, J. Thomas ;
Gerstein, Hertzel C. ;
Ismail-Beigi, Faramarz .
NEW ENGLAND JOURNAL OF MEDICINE, 2010, 362 (17) :1575-1585
[8]   General cardiovascular risk profile for use in primary care - The Framingham Heart Study [J].
D'Agostino, Ralph B. ;
Vasan, Ramachandran S. ;
Pencina, Michael J. ;
Wolf, Philip A. ;
Cobain, Mark ;
Massaro, Joseph M. ;
Kannel, William B. .
CIRCULATION, 2008, 117 (06) :743-753
[9]   Learning About Machine Learning: The Promise and Pitfalls of Big Data and the Electronic Health Record [J].
Deo, Rahul C. ;
Nallamothu, Brahmajee K. .
CIRCULATION-CARDIOVASCULAR QUALITY AND OUTCOMES, 2016, 9 (06) :618-620
[10]   Estimating treatment effects for individual patients based on the results of randomised clinical trials [J].
Dorresteijn, Johannes A. N. ;
Visseren, Frank L. J. ;
Ridker, Paul M. ;
Wassink, Annemarie M. J. ;
Paynter, Nina P. ;
Steyerberg, Ewout W. ;
van der Graaf, Yolanda ;
Cook, Nancy R. .
BMJ-BRITISH MEDICAL JOURNAL, 2011, 343