Measuring and Bounding Experimenter Demand

被引:263
作者
de Quidt, Jonathan [1 ]
Haushofer, Johannes [2 ,3 ,4 ,5 ]
Roth, Christopher [6 ,7 ]
机构
[1] Stockholm Univ, Inst Int Econ Studies, S-10691 Stockholm, Sweden
[2] Princeton Univ, Dept Psychol, 427 Peretsman Scully Hall, Princeton, NJ 08540 USA
[3] Princeton Univ, Woodrow Wilson Sch Publ & Int Affairs, 427 Peretsman Scully Hall, Princeton, NJ 08540 USA
[4] NBER, Cambridge, MA 02138 USA
[5] Busara Ctr Behav Econ, Nairobi, Kenya
[6] Univ Oxford, Dept Econ, Keble Coll, Parks Rd, Oxford OX1 3PG, England
[7] CSAE, Toronto, ON, Canada
关键词
MEASURING SOCIAL PREFERENCES; DICTATOR GAME; ANONYMITY;
D O I
10.1257/aer.20171330
中图分类号
F [经济];
学科分类号
02 ;
摘要
We propose a technique for assessing robustness to demand effects of findings from experiments and surveys. The core idea is that by deliberately inducing demand in a structured way we can bound its influence. We present a model in which participants respond to their beliefs about the researcher's objectives. Bounds are obtained by manipulating those beliefs with "demand treatments." We apply the method to 11 classic tasks, and estimate bounds averaging 0.13 standard deviations, suggesting that typical demand effects are probably modest. We also show how to compute demand-robust treatment effects and how to structurally estimate the model.
引用
收藏
页码:3266 / 3302
页数:37
相关论文
共 50 条
[1]   Scaling for Economists: Lessons from the Non-Adherence Problem in the Medical Literature [J].
Al-Ubaydli, Omar ;
List, John A. ;
Lore, Danielle ;
Suskind, Dana .
JOURNAL OF ECONOMIC PERSPECTIVES, 2017, 31 (04) :125-144
[2]   Evaluating Behaviorally Motivated Policy: Experimental Evidence from the Lightbulb Market [J].
Allcott, Hunt ;
Taubinsky, Dmitry .
AMERICAN ECONOMIC REVIEW, 2015, 105 (08) :2501-2538
[3]  
[Anonymous], 1992, Questions about Questions: Inquiries into the Cognitive Bases of Surveys
[4]   Dictator game giving: altruism or artefact? [J].
Bardsley, Nicholas .
EXPERIMENTAL ECONOMICS, 2008, 11 (02) :122-133
[5]   Big experimenter is watching you! Anonymity and prosocial behavior in the laboratory [J].
Barmettler, Franziska ;
Fehr, Ernst ;
Zehnder, Christian .
GAMES AND ECONOMIC BEHAVIOR, 2012, 75 (01) :17-34
[6]   Separating the Shirkers from the Workers? Making Sure Respondents Pay Attention on Self-Administered Surveys [J].
Berinsky, Adam J. ;
Margolis, Michele F. ;
Sances, Michael W. .
AMERICAN JOURNAL OF POLITICAL SCIENCE, 2014, 58 (03) :739-753
[7]   Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk [J].
Berinsky, Adam J. ;
Huber, Gregory A. ;
Lenz, Gabriel S. .
POLITICAL ANALYSIS, 2012, 20 (03) :351-368
[8]   Do people mean what they say? Implications for subjective survey data [J].
Bertrand, M ;
Mullainathan, S .
AMERICAN ECONOMIC REVIEW, 2001, 91 (02) :67-72
[9]  
BINMORE K, 1985, AM ECON REV, V75, P1178
[10]  
Bischoff I, 2011, ECON BULL, V31, P3221