Use of the estimated intraclass correlation for correcting differences in effect size by level

被引:12
作者
Ahn, Soyeon [1 ]
Myers, Nicolas D. [1 ]
Jin, Ying [1 ]
机构
[1] Univ Miami, Coral Gables, FL 33124 USA
关键词
Intraclass correlation (ICC); Meta-analysis; Standardized mean difference; Multilevel; Level of analysis;
D O I
10.3758/s13428-011-0153-1
中图分类号
B841 [心理学研究方法];
学科分类号
040201 ;
摘要
In a meta-analysis of intervention or group comparison studies, researchers often encounter the circumstance in which the standardized mean differences (-effect sizes) are computed at multiple levels (e.g., individual vs. cluster). Cluster-level -effect sizes may be inflated and, thus, may need to be corrected using the intraclass correlation (ICC) before being combined with individual-level -effect sizes. The ICC value, however, is seldom reported in primary studies and, thus, may need to be computed from other sources. This article proposes a method for estimating the ICC value from the reported standard deviations within a particular meta-analysis (i.e., estimated ICC) when an appropriate default ICC value (Hedges, 2009b) is unavailable. A series of simulations provided evidence that the proposed method yields an accurate and precise estimated ICC value, which can then be used for correct estimation of a -effect size. The effects of other pertinent factors (e.g., number of studies) were also examined, followed by discussion of related limitations and future research in this area.
引用
收藏
页码:490 / 502
页数:13
相关论文
共 25 条
[1]  
Ahn S., 2011, INCORPORATING UNPUB
[2]  
[Anonymous], 2008, Procedures and standards handbook
[3]  
[Anonymous], 1998, Introducing multilevel modeling
[4]  
[Anonymous], 2017, Techniques and Applications, DOI DOI 10.4324/9781315650982
[5]  
Cohen J., 1988, Statistical power analysis for the behavioral sciences, VSecond
[6]  
Cooper H., 2009, The handbook of research synthesis and Metaanalysis, V2nd, DOI DOI 10.7758/9781610448864
[7]   Correcting a significance test for clustering [J].
Hedges, Larry V. .
JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS, 2007, 32 (02) :151-179
[8]   Intraclass correlation values for planning group-randomized trials in education [J].
Hedges, Larry V. ;
Hedberg, E. C. .
EDUCATIONAL EVALUATION AND POLICY ANALYSIS, 2007, 29 (01) :60-87
[9]   Adjusting a Significance Test for Clustering in Designs With Two Levels of Nesting [J].
Hedges, Larry V. .
JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS, 2009, 34 (04) :464-490
[10]  
Hedges LV., 2009, HDB RES SYNTHESIS ME, P337