Randomized controlled trials of biomarker targets

Introduction: Randomized controlled trials are used to estimate the causal effect of a treatment on a health outcome of interest in a patient population. Often the specified treatment in a randomized controlled trial is a medical intervention-such as a drug or procedure-experienced directly by the patient. Sometimes the "treatment" in a randomized controlled trial is a target-such as a goal biomarker measurement-that the patient's physician attempts to reach using available medications or procedures. Large randomized controlled trials of biomarker targets are common in clinical research, and trials have been conducted to compare targets in the management of hypertension, diabetes, anemia, and acute respiratory distress syndrome. However, different randomized controlled trials intended to evaluate the same biomarker targets have produced conflicting recommendations, and meta-analyses that aggregate results of trials of biomarker targets have been inconclusive. Methods: We use causal reasoning to explain why randomized controlled trials of biomarker targets can arrive at conflicting or misleading conclusions. We describe four key threats to the validity of trials of targets: (1) intention-to-treat analysis can be misleading when a direct effect of target assignment on the outcome exists due to lack of blinding; (2) incomparability in results across trials of targets; (3) time-varying adaptive treatment strategies; and (4) Goodhart's law, "when a measure becomes a target, it ceases to be a good measure." Results: We illustrate these findings using evidence from 15 randomized controlled trials of blood pressure targets for management of hypertension. Randomized trials of blood pressure targets exhibit substantial variation in the trial patient populations and antihypertensives used to achieve the blood pressure targets assigned in the trials. The trials did not compare or account for time-varying treatment strategies used to reach the randomized targets. Possible "off-target" effects of antihypertensive medications needed to reach lower blood pressure targets may explain the absence of a clear benefit from intensive blood pressure control. Discussion: Researchers should critically assess meta-analyses of trials of targets for variation in the types, distributions, and off-target effects of therapies studied. Trial investigators should release detailed information about the biomarker targets compared in new randomized trials, as well as confounders, treatments delivered, and outcomes. New randomized controlled trials should experimentally compare treatment algorithms incorporating biomarkers, rather than targets alone. Causal inference methodology that adjusts for time-varying confounding should be used to compare time-varying treatment strategies in observational settings.