Translating Standardized Effects of Education Programs Into More Interpretable Metrics

被引:38
作者
Baird, Matthew D. [1 ]
Pane, John F. [1 ]
机构
[1] RAND Corp, 4570 Fifth Ave,Suite 600, Pittsburgh, PA 15213 USA
基金
比尔及梅琳达.盖茨基金会;
关键词
education program effects; education policy; program evaluation; research utilization; standardized effect sizes; translation of research results; years of learning; GROWTH;
D O I
10.3102/0013189X19848729
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Evaluators report effects of education initiatives as standardized effect sizes, a scale that has merits but obscures interpretation of the effects' practical importance. Consequently, educators and policymakers seek more readily interpretable translations of evaluation results. One popular metric is the number of years of learning necessary to induce the effect. We compare years of learning to three other translation options: benchmarking against other effect sizes, converting to percentile growth, and estimating the probability of scoring above a proficiency threshold. After enumerating the desirable properties of translations, we examine each option's strengths and weaknesses. We conclude that years of learning performs worst, and percentile gains performs best, making it our recommended choice for more interpretable translations of standardized effects.
引用
收藏
页码:217 / 228
页数:12
相关论文
共 22 条
[1]  
[Anonymous], 2017, Evaluation of the Achievement Levels for Mathematics and Reading on the National Assessment of Educational Progress, DOI DOI 10.17226/23409
[2]  
Bloom H.S., 2008, J RES EDUC EFF, V1, P289, DOI [10.1080/19345740802400072, DOI 10.1080/19345740802400072]
[3]   Measuring Growth With Vertical Scales [J].
Briggs, Derek C. .
JOURNAL OF EDUCATIONAL MEASUREMENT, 2013, 50 (02) :204-226
[4]  
Childress S., 2017, REIMAGING LEARNING B
[5]  
Dadey N., 2012, Practical Assessment, Research, Evaluation, V17
[6]  
Dorn S., 2015, SHERMAN DORN WORK UN
[7]  
Hanushek EricA., 2012, ED NEXT, V12
[8]  
Hedges LV., 1981, J. Educ. Stat, V6, P107, DOI [DOI 10.3102/10769986006002107, 10.2307/1164588]
[9]   Empirical Benchmarks for Interpreting Effect Sizes in Research [J].
Hill, Carolyn J. ;
Bloom, Howard S. ;
Black, Alison Rebeck ;
Lipsey, Mark W. .
CHILD DEVELOPMENT PERSPECTIVES, 2008, 2 (03) :172-177
[10]   Experimental estimates of education production functions [J].
Krueger, AB .
QUARTERLY JOURNAL OF ECONOMICS, 1999, 114 (02) :497-532