Testing for heterogeneous treatment effects in experimental data: false discovery risks and correction procedures

被引:29
作者
Fink, Guenther [1 ]
McConnell, Margaret [1 ]
Vollmer, Sebastian [1 ,2 ]
机构
[1] Harvard Univ, Sch Publ Hlth, Dept Global Hlth & Populat, Boston, MA 02115 USA
[2] Univ Gottingen, Dept Econ, D-37073 Gottingen, Germany
关键词
multiple testing; heterogeneous treatment effects; experimental design; randomised field experiments;
D O I
10.1080/19439342.2013.875054
中图分类号
F0 [经济学]; F1 [世界各国经济概况、经济史、经济地理]; C [社会科学总论];
学科分类号
0201 ; 020105 ; 03 ; 0303 ;
摘要
We review the statistical models applied to test for heterogeneous treatment effects in the recent empirical literature, with a particular focus on data from randomised field experiments. We show that testing for heterogeneous treatment effects is highly common, and likely to result in a large number of false discoveries when conventional decision rules are applied. We demonstrate that applying correction procedures developed in the statistics literature can fully address this issue, and discuss the implications of multiple testing adjustments for power calculations and experimental design.
引用
收藏
页码:44 / 57
页数:14
相关论文
共 22 条
[1]   Vouchers for private schooling in Colombia: Evidence from a randomized natural experiment [J].
Angrist, J ;
Bettinger, E ;
Bloom, E ;
King, E ;
Kremer, M .
AMERICAN ECONOMIC REVIEW, 2002, 92 (05) :1535-1558
[2]   Treatment effect heterogeneity in theory and practice [J].
Angrist, JD .
ECONOMIC JOURNAL, 2004, 114 (494) :C52-C83
[3]  
[Anonymous], MULTIPLE TESTING NEW
[4]  
Benjamini Y, 2001, ANN STAT, V29, P1165
[5]   CONTROLLING THE FALSE DISCOVERY RATE - A PRACTICAL AND POWERFUL APPROACH TO MULTIPLE TESTING [J].
BENJAMINI, Y ;
HOCHBERG, Y .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 1995, 57 (01) :289-300
[6]   The Role of Theory in Field Experiments [J].
Card, David ;
DellaVigna, Stefano ;
Malmendier, Ulrike .
JOURNAL OF ECONOMIC PERSPECTIVES, 2011, 25 (03) :39-62
[7]   Instruments, Randomization, and Learning about Development [J].
Deaton, Angus .
JOURNAL OF ECONOMIC LITERATURE, 2010, 48 (02) :424-455
[8]  
Duflo E, 2008, HBK ECON, V9, P3895, DOI 10.1016/S1573-4471(07)04061-2
[9]  
Engemann KM, 2009, FED RESERVE BANK ST, V91, P127
[10]   A review of modern multiple hypothesis testing, with particular attention to the false discovery proportion [J].
Farcomeni, Alessio .
STATISTICAL METHODS IN MEDICAL RESEARCH, 2008, 17 (04) :347-388