Interpreting Effect Sizes of Education Interventions

被引:695
作者
Kraft, Matthew A. [1 ]
机构
[1] Brown Univ, Educ & Econ, POB 1938, Providence, RI 02912 USA
关键词
education policy; education reform; effect size; evaluation; experimental research; policy analysis; program evaluation; ACHIEVEMENT; IMPACTS; METAANALYSIS; PERFORMANCE; BENCHMARKS; PROGRAMS; POLICY;
D O I
10.3102/0013189X20912798
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Researchers commonly interpret effect sizes by applying benchmarks proposed by Jacob Cohen over a half century ago. However, effects that are small by Cohen's standards are large relative to the impacts of most field-based interventions. These benchmarks also fail to consider important differences in study features, program costs, and scalability. In this article, I present five broad guidelines for interpreting effect sizes that are applicable across the social sciences. I then propose a more structured schema with new empirical benchmarks for interpreting a specific class of studies: causal research on education interventions with standardized achievement outcomes. Together, these tools provide a practical approach for incorporating study features, costs, and scalability into the process of interpreting the policy importance of effect sizes.
引用
收藏
页码:241 / 253
页数:13
相关论文
共 69 条
[1]  
Allcott H, 2015, Q J ECON, V130, P1117, DOI 10.1093/qje/qjv015
[2]   American education research changes tack [J].
Angrist, JD .
OXFORD REVIEW OF ECONOMIC POLICY, 2004, 20 (02) :198-212
[3]   Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice [J].
Angrist, Joshua D. ;
Cohodes, Sarah R. ;
Dynarski, Susan M. ;
Pathak, Parag A. ;
Walters, Christopher R. .
JOURNAL OF LABOR ECONOMICS, 2016, 34 (02) :275-318
[4]  
[Anonymous], 2012, Translating the statistical representation of the effects of education interventions into more readily interpretable forms
[5]   Persistence and Fadeout in the Impacts of Child and Adolescent Interventions [J].
Bailey, Drew ;
Duncan, Greg J. ;
Odgers, Candice L. ;
Yu, Winnie .
JOURNAL OF RESEARCH ON EDUCATIONAL EFFECTIVENESS, 2017, 10 (01) :7-39
[6]   Translating Standardized Effects of Education Programs Into More Interpretable Metrics [J].
Baird, Matthew D. ;
Pane, John F. .
EDUCATIONAL RESEARCHER, 2019, 48 (04) :217-228
[7]  
BLOOM BS, 1984, EDUC LEADERSHIP, V41, P4
[8]  
Bloom H.S., 2008, J RES EDUC EFF, V1, P289, DOI [10.1080/19345740802400072, DOI 10.1080/19345740802400072]
[9]  
Boulay B., 2018, 20184013 NCEE EE 20
[10]   THE VALUE OF SCHOOL FACILITY INVESTMENTS: EVIDENCE FROM A DYNAMIC REGRESSION DISCONTINUITY DESIGN [J].
Cellini, Stephanie Riegg ;
Ferreira, Fernando ;
Rothstein, Jesse .
QUARTERLY JOURNAL OF ECONOMICS, 2010, 125 (01) :215-261