Power analysis for single-case designs: Computations for (AB)k designs

被引:0
作者
Larry V. Hedges
William R. Shadish
Prathiba Natesan Batley
机构
[1] Northwestern University,Department of Statistics
[2] University of California,Department of Counseling and Human Development
[3] University of Louisville,undefined
来源
Behavior Research Methods | 2023年 / 55卷
关键词
Power; Single case experimental designs; Type-II error; Type-I error; Single case designs; ABAB designs;
D O I
暂无
中图分类号
学科分类号
摘要
Currently, the design standards for single-case experimental designs (SCEDs) are based on validity considerations as prescribed by the What Works Clearinghouse. However, there is a need for design considerations such as power based on statistical analyses. We compute and derive power using computations for (AB)k designs with multiple cases which are common in SCEDs. Our computations show that effect size has the maximum impact on power followed by the number of subjects and then the number of phase reversals. An effect size of 0.75 or higher, at least one set of phase reversals (i.e., where k > 1), and at least three subjects showed high power. The latter two conditions agree with current standards about either having at least an ABAB design or a multiple baseline design with three subjects to meet design standards. An effect size of 0.75 or higher is not uncommon in SCEDs either. Autocorrelations, the number of time-points per phase, and intraclass correlations had a smaller but non-negligible impact on power. In sum, power analyses in the present study show that conditions to meet power requirements are not unreasonable in SCEDs. The software code to compute power is available on GitHub for the use of the reader.
引用
收藏
页码:3494 / 3503
页数:9
相关论文
共 30 条
[1]  
Ferron JM(2017)A Monte Carlo evaluation of masked visual analysis in response-guided versus fixed-criteria multiple-baseline designs Journal of Applied Behavior Analysis 50 701-716
[2]  
Joo S-H(2007)Effect sizes in cluster randomized designs Journal of Educational and Behavioral Statistics 32 341-370
[3]  
Levin JR(2012)A standardized mean difference effect size for single case designs Journal of Research Synthesis Methods 3 224-239
[4]  
Hedges LV(2013)A standardized mean difference effect size for multiple baseline designs Journal of Research Synthesis Methods 4 324-341
[5]  
Hedges LV(2017)Testing the intervention effect in single-case experiments: A Monte Carlo simulation study The Journal of Experimental Education 85 175-196
[6]  
Pustejovsky JE(2021)Accurate models vs. accurate estimates: A simulation study of Bayesian single-case experimental designs Behavior Research Methods 53 1782-1798
[7]  
Shadish WR(2020)Investigating immediacy in multiple phase-change single case experimental designs using a Bayesian unknown change-points model Behavior Research Methods 52 1714-1728
[8]  
Hedges LV(2017)Bayesian unknown change-point models to investigate immediacy in single case designs Psychological Methods 22 743-759
[9]  
Pustejovsky JE(2008)Characteristics of single-case designs used to assess intervention effects in 2008 Behavioral Research Methods 43 971-980
[10]  
Shadish WR(2013)Bayesian estimates of autocorrelations in single-case designs Behavioral Research Methods 45 813-821