Behavioural science is unlikely to change the world without a heterogeneity revolution

被引:319
作者
Bryan, Christopher J. [1 ]
Tipton, Elizabeth [2 ]
Yeager, David S. [1 ]
机构
[1] Univ Texas Austin, Austin, TX 78712 USA
[2] Northwestern Univ, Evanston, IL 60208 USA
关键词
CONTEXTUAL SENSITIVITY; INTERVENTIONS; CREDIBILITY; SAMPLE; POWER; GAP;
D O I
10.1038/s41562-021-01143-3
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Behavioural science increasingly informs policy, but findings are not always replicated. Bryan et al. describe an emerging heterogeneity revolution. They recommend that researchers use heterogeneity in treatment effects to develop more robust theories of causality and strengthen the field. In the past decade, behavioural science has gained influence in policymaking but suffered a crisis of confidence in the replicability of its findings. Here, we describe a nascent heterogeneity revolution that we believe these twin historical trends have triggered. This revolution will be defined by the recognition that most treatment effects are heterogeneous, so the variation in effect estimates across studies that defines the replication crisis is to be expected as long as heterogeneous effects are studied without a systematic approach to sampling and moderation. When studied systematically, heterogeneity can be leveraged to build more complete theories of causal mechanism that could inform nuanced and dependable guidance to policymakers. We recommend investment in shared research infrastructure to make it feasible to study behavioural interventions in heterogeneous and generalizable samples, and suggest low-cost steps researchers can take immediately to avoid being misled by heterogeneity and begin to learn from it instead.
引用
收藏
页码:980 / 989
页数:10
相关论文
共 120 条
[1]   Estimating the reproducibility of psychological science [J].
Aarts, Alexander A. ;
Anderson, Joanna E. ;
Anderson, Christopher J. ;
Attridge, Peter R. ;
Attwood, Angela ;
Axt, Jordan ;
Babel, Molly ;
Bahnik, Stepan ;
Baranski, Erica ;
Barnett-Cowan, Michael ;
Bartmess, Elizabeth ;
Beer, Jennifer ;
Bell, Raoul ;
Bentley, Heather ;
Beyan, Leah ;
Binion, Grace ;
Borsboom, Denny ;
Bosch, Annick ;
Bosco, Frank A. ;
Bowman, Sara D. ;
Brandt, Mark J. ;
Braswell, Erin ;
Brohmer, Hilmar ;
Brown, Benjamin T. ;
Brown, Kristina ;
Bruening, Jovita ;
Calhoun-Sauls, Ann ;
Callahan, Shannon P. ;
Chagnon, Elizabeth ;
Chandler, Jesse ;
Chartier, Christopher R. ;
Cheung, Felix ;
Christopherson, Cody D. ;
Cillessen, Linda ;
Clay, Russ ;
Cleary, Hayley ;
Cloud, Mark D. ;
Cohn, Michael ;
Cohoon, Johanna ;
Columbus, Simon ;
Cordes, Andreas ;
Costantini, Giulio ;
Alvarez, Leslie D. Cramblet ;
Cremata, Ed ;
Crusius, Jan ;
DeCoster, Jamie ;
DeGaetano, Michelle A. ;
Della Penna, Nicolas ;
den Bezemer, Bobby ;
Deserno, Marie K. .
SCIENCE, 2015, 349 (6251)
[2]   Reexamining the "Racial Gap" in Political Knowledge [J].
Abrajano, Marisa .
JOURNAL OF POLITICS, 2015, 77 (01) :44-54
[3]  
Afif Zeina., 2018, Behavioral Science around the World: Profiles of 10 Countries'
[4]  
Alexander, 2019, LINKS 12 19 SLATE ST
[5]  
Allcott H, 2015, Q J ECON, V130, P1117, DOI 10.1093/qje/qjv015
[6]   The Short-Run and Long-Run Effects of Behavioral Interventions: Experimental Evidence from Energy Conservation [J].
Allcott, Hunt ;
Rogers, Todd .
AMERICAN ECONOMIC REVIEW, 2014, 104 (10) :3003-3037
[7]   Social norms and energy conservation [J].
Allcott, Hunt .
JOURNAL OF PUBLIC ECONOMICS, 2011, 95 (9-10) :1082-1095
[8]   Science that can change the world [J].
不详 .
NATURE HUMAN BEHAVIOUR, 2019, 3 (06) :539-539
[9]  
[Anonymous], 2020, REQUEST APPL ED RES
[10]  
Appelbaum B., 2015, New York Times