Re-conceptualizing SMART designs as a hybrid of randomized and regression discontinuity designs: opportunities, cautions

被引:1
|
作者
Yeaton, William Herbert [1 ,2 ]
机构
[1] Florida State Univ, Measurement & Stat Educ, Tallahassee, FL USA
[2] Stone Bldg, 1114 W Call St, Tallahassee, FL 32306 USA
关键词
SMART design; hybrid design; experiment; regression discontinuity; adaptive treatments; educational interventions; ADAPTIVE INTERVENTIONS; MULTIPLE-ASSIGNMENT; METAANALYSIS; PERFORMANCE; EDUCATION;
D O I
10.1080/1743727X.2023.2220649
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Though previously unacknowledged, a SMART (Sequential Multiple Assignment Randomized Trial) design uses both regression discontinuity (RD) and randomized controlled trial (RCT) designs. This combination structure creates a conceptual symbiosis between the two designs that enables both RCT- and previously unrecognized, RD-based inferential claims. In Phase 1, based on a quantitative cut-point, a SMART design yields successful or unsuccessful participants after the initial RCT. In Phase 2, interventions are randomly assigned to successful and unsuccessful, Phase 1 subgroups, thereby yielding both RCT and RD results. Like RCT-based inferences, many but not all newly recognized, RD-based SMART inferences are potentially unbiased. In particular, comparisons between RCT and RD outcomes are potentially problematic. Principles from the within-study comparison literature are used to inform SMART-based research, thereby introducing otherwise ignored inferential and procedural possibilities. Awareness of RD designs embedded within SMARTs encourages previously unrecognized inferential claims, though potential internal validity threats and limitations must be carefully weighed. Finally, new, SMART-like sequences of quasi-experiments and experiments can be tested and embedded logic applied.
引用
收藏
页码:140 / 155
页数:16
相关论文
共 32 条
  • [21] Design and Analysis of Clustered Regression Discontinuity Designs for Probing Mediation Effects
    Bai, Fangxing
    Kelcey, Ben
    Xie, Yanli
    Cox, Kyle
    JOURNAL OF EXPERIMENTAL EDUCATION, 2025, 93 (02): : 419 - 449
  • [22] Extrapolating Treatment Effects in Multi-Cutoff Regression Discontinuity Designs
    Cattaneo, Matias D.
    Keele, Luke
    Titiunik, Rocio
    Vazquez-Bare, Gonzalo
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2021, 116 (536) : 1941 - 1952
  • [23] Bounds on treatment effects in regression discontinuity designs with a manipulated running variable
    Gerard, Francois
    Rokkanen, Miikka
    Rothe, Christoph
    QUANTITATIVE ECONOMICS, 2020, 11 (03) : 839 - 870
  • [24] Regression discontinuity designs are underutilized in medicine, epidemiology, and public health: a review of current and best practice
    Moscoe, Ellen
    Bor, Jacob
    Baernighausen, Till
    JOURNAL OF CLINICAL EPIDEMIOLOGY, 2015, 68 (02) : 132 - 143
  • [25] Why High-Order Polynomials Should Not Be Used in Regression Discontinuity Designs
    Gelman, Andrew
    Imbens, Guido
    JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 2019, 37 (03) : 447 - 456
  • [26] A Correction for Regression Discontinuity Designs With Group-Specific Mismeasurement of the Running Variable
    Bartalotti, Otavio
    Brummet, Quentin
    Dieterle, Steven
    JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 2021, 39 (03) : 833 - 848
  • [27] Using Data from Randomized Trials to Assess the Likely Generalizability of Educational Treatment-Effect Estimates from Regression Discontinuity Designs
    Bloom, Howard
    Bell, Andrew
    Reiman, Kayla
    JOURNAL OF RESEARCH ON EDUCATIONAL EFFECTIVENESS, 2020, 13 (03) : 488 - 517
  • [28] Regression discontinuity designs: an approach to the evaluation of treatment efficacy in primary care using observational data
    O'Keeffe, Aidan G.
    Geneletti, Sara
    Baio, Gianluca
    Sharples, Linda D.
    Nazareth, Irwin
    Petersen, Irene
    BMJ-BRITISH MEDICAL JOURNAL, 2014, 349
  • [29] Analyzing Regression-Discontinuity Designs With Multiple Assignment Variables: A Comparative Study of Four Estimation Methods
    Wong, Vivian C.
    Steiner, Peter M.
    Cook, Thomas D.
    JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS, 2013, 38 (02) : 107 - 141
  • [30] The Effect of Serving "Breakfast After-the-Bell" Meals on School Absenteeism: Comparing Results From Regression Discontinuity Designs
    Kirksey, J. Jacob
    Gottfried, Michael A.
    EDUCATIONAL EVALUATION AND POLICY ANALYSIS, 2021, 43 (02) : 305 - 328