Using cluster random assignment to measure program impacts - Statistical implications for the evaluation of education programs

被引:77
作者
Bloom, HS [1 ]
Bos, JM [1 ]
Lee, SW [1 ]
机构
[1] NYU, Robert F Wagner Sch Publ Serv, New York, NY 10012 USA
关键词
D O I
10.1177/0193841X9902300405
中图分类号
C [社会科学总论];
学科分类号
03 ; 0303 ;
摘要
This article explores the possibility of randomly assigning groups (or clusters) of individuals to a program or a control group to estimate the impacts of programs designed to affect whole groups. This cluster assignment approach maintains the primary strength of random assignment-the provision of unbiased impact estimates-but has less statistical power than random assignment of individuals, which usually is not possible for programs focused on whole groups. To explore the statistical implications of cluster assignment, the authors (a) outline the issues involved, (b) present an analytic framework for studying these issues, and (c) apply this framework to assess the potential for using the approach to evaluate education programs targeted on whole schools. The findings suggest that cluster assignment of schools holds some promise for estimating the impacts of education programs when it is possible to control for the average performance of past student cohorts or the past performance of individual students.
引用
收藏
页码:445 / 469
页数:25
相关论文
共 19 条
[1]   ACCOUNTING FOR NO-SHOWS IN EXPERIMENTAL EVALUATION DESIGNS [J].
BLOOM, HS .
EVALUATION REVIEW, 1984, 8 (02) :225-246
[3]   The benefits and costs of JTPA Title II-A programs - Key findings from the National Job Training Partnership Act Study [J].
Bloom, HS ;
Orr, LL ;
Bell, SH ;
Cave, G ;
Doolittle, F ;
Lin, W ;
Bos, JM .
JOURNAL OF HUMAN RESOURCES, 1997, 32 (03) :549-576
[4]  
Cochran WG., 1963, Sampling techniques, V2nd ed., DOI [10.1002/bimj.19650070312, DOI 10.1002/BIMJ.19650070312]
[5]  
Cohen J., 1988, Statistical Power Analysis for the Behavioral Sciences, V2
[6]  
Connell J., 1995, New approaches to evaluating community initiatives
[7]  
Freedman S., 1995, JOBS EVALUATION EARL
[8]  
GARFINKEL L, 1992, EVALUATING WELFARE T
[9]  
Glass G.V., 1981, Meta-analysis in social research
[10]   THE CHANGING-ROLE OF SOCIAL EXPERIMENTS IN POLICY ANALYSIS [J].
GREENBERG, DH ;
ROBINS, PK .
JOURNAL OF POLICY ANALYSIS AND MANAGEMENT, 1986, 5 (02) :340-362