Effect size measures for multilevel models:definition, interpretation, and TIMSS example

被引:521
作者
Lorah, Julie [1 ]
机构
[1] Indiana Univ, Bloomington, IN 47405 USA
关键词
Multilevel model; Effect size; TIMSS;
D O I
10.1186/s40536-018-0061-2
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Effect size reporting is crucial for interpretation of applied research results and for conducting meta-analysis. However, clear guidelines for reporting effect size in multilevel models have not been provided. This report suggests and demonstrates appropriate effect size measures including the ICC for random effects and standardized regression coefficients or f(2) for fixed effects. Following this, complexities associated with reporting R-2 as an effect size measure are explored, as well as appropriate effect size measures for more complex models including the three-level model and the random slopes model. An example using TIMSS data is provided.
引用
收藏
页数:11
相关论文
共 21 条
[1]  
Aiken L.S., 1991, MULTIPLE REGRESSION
[2]   Fitting Linear Mixed-Effects Models Using lme4 [J].
Bates, Douglas ;
Maechler, Martin ;
Bolker, Benjamin M. ;
Walker, Steven C. .
JOURNAL OF STATISTICAL SOFTWARE, 2015, 67 (01) :1-48
[3]   A POWER PRIMER [J].
COHEN, J .
PSYCHOLOGICAL BULLETIN, 1992, 112 (01) :155-159
[4]   Meta-Analysis in Higher Education: An Illustrative Example Using Hierarchical Linear Modeling [J].
Denson, Nida ;
Seltzer, Michael H. .
RESEARCH IN HIGHER EDUCATION, 2011, 52 (03) :215-244
[5]  
Ferron JM, 2008, QUANT METH EDUC BEHA, P391
[6]   Intraclass correlation values for planning group-randomized trials in education [J].
Hedges, Larry V. ;
Hedberg, E. C. .
EDUCATIONAL EVALUATION AND POLICY ANALYSIS, 2007, 29 (01) :60-87
[7]  
Hox J. J., 2017, MULTILEVEL ANAL TECH, V3rd
[8]   On Effect Size [J].
Kelley, Ken ;
Preacher, Kristopher J. .
PSYCHOLOGICAL METHODS, 2012, 17 (02) :137-152
[9]  
Kirk R, 2013, EXPT DESIGN PROCEDUR
[10]  
Maas C., 2005, METHODOLOGY-EUR, V1, P86, DOI [10.1027/1614-2241.1.3.86, DOI 10.1027/1614-2241.1.3.86, 10.1027/1614- 2241.1.3.86]