Assessing Nonoverlap in Single-Case Data: Strengths, Challenges, and Recommendations

被引:2
作者
Manolov, Rumen [1 ]
Tanious, Rene [2 ,3 ]
机构
[1] Univ Barcelona, Fac Psychol, Dept Social Psychol & Quantitat Psychol, Passeig Vall dHebron 171, Barcelona 08035, Spain
[2] Vrije Univ Brussel, Fac Psychol & Educ Sci, Ixelles, Belgium
[3] Fac Psychol & Neurosci, Univ Singel 40, NL-6229 ER Maastricht, Netherlands
关键词
Single-case experimental designs; Visual analysis; Overlap; Consistency; MASKED VISUAL ANALYSIS; CASE RESEARCH DESIGNS; BASE-LINE DESIGNS; EFFECT SIZE; QUANTITATIVE SYNTHESIS; SUBJECT RESEARCH; STATISTICAL-ANALYSIS; RANDOMIZATION TESTS; OVERLAP METHODS; PERCENTAGE;
D O I
10.1007/s10864-024-09552-w
中图分类号
G76 [特殊教育];
学科分类号
040109 ;
摘要
Overlap is one of the data aspects that are expected to be assessed when visually inspecting single-case experimental designs (SCED) data. A frequently used quantification of overlap is the Nonoverlap of All Pairs (NAP). The current article reviews the main strengths and challenges when using this index, as compared to other nonoverlap indices such as Tau and the Percentage of data points exceeding the median. Four challenges are reviewed: the difficulty in representing NAP graphically, the presence of a ceiling effect, the disregard of trend, and the limitations in using p-values associated with NAP. Given the importance of complementing quantitative analysis and visual inspection of graphed data, straightforward quantifications and new graphical elements for the time-series plot are proposed as options for addressing the first three challenges. The suggestions for graphical representations (representing within-phase monotonic trend and across-phases overlaps) and additional numerical summaries (quantifying the degree of separation in case of complete nonoverlap or the proportion of data points in the overlap zone) are illustrated with two multiple-baseline data sets. To make it easier to obtain the plots and quantifications, the recommendations are implemented in a freely available user-friendly website. Educational researchers can use this article to inform their use and application of NAP to meaningfully interpret this quantification in the context of SCEDs.
引用
收藏
页数:33
相关论文
共 136 条
[31]   Using AB Designs With Nonoverlap Effect Size Measures to Support Clinical Decision-Making: A Monte Carlo Validation [J].
Giannakakos, Antonia R. ;
Lanovaz, Marc J. .
BEHAVIOR MODIFICATION, 2023, 47 (06) :1407-1422
[32]   Review of assumptions and problems in the appropriate conceptualization of effect size [J].
Grissom, RJ ;
Kim, JJ .
PSYCHOLOGICAL METHODS, 2001, 6 (02) :135-146
[33]   Comparing Visual and Statistical Analysis in Single-Case Studies Using Published Studies [J].
Harrington, Magadalena ;
Velicer, Wayne F. .
MULTIVARIATE BEHAVIORAL RESEARCH, 2015, 50 (02) :162-183
[34]   CHANGING CRITERION DESIGN [J].
HARTMANN, DP ;
HALL, RV .
JOURNAL OF APPLIED BEHAVIOR ANALYSIS, 1976, 9 (04) :527-532
[35]   Overlap Between Treatment and Control Distributions as an Effect Size Measure in Experiments [J].
Hedges, Larry V. ;
Olkin, Ingram .
PSYCHOLOGICAL METHODS, 2016, 21 (01) :61-68
[36]   A standardized mean difference effect size for single case designs [J].
Hedges, Larry V. ;
Pustejovsky, James E. ;
Shadish, William R. .
RESEARCH SYNTHESIS METHODS, 2012, 3 (03) :224-239
[37]   Randomization tests for single-case experiments: State of the art, state of the science, and state of the application [J].
Heyvaert, Mieke ;
Onghena, Patrick .
JOURNAL OF CONTEXTUAL BEHAVIORAL SCIENCE, 2014, 3 (01) :51-64
[38]   Comparing the percentage of non-overlapping data approach and the hierarchical linear modeling approach for synthesizing single-case studies in autism research [J].
Heyvaert, Mieke ;
Saenen, Lore ;
Maes, Bea ;
Onghena, Patrick .
RESEARCH IN AUTISM SPECTRUM DISORDERS, 2015, 11 :112-125
[39]   Analysis of single-case data: Randomisation tests for measures of effect size [J].
Heyvaert, Mieke ;
Onghena, Patrick .
NEUROPSYCHOLOGICAL REHABILITATION, 2014, 24 (3-4) :507-527
[40]  
Horner R.H., 2014, Single case intervention research: Methodological and statistical advances, P27, DOI [10.1037/14376-002, DOI 10.1037/14376-002]