Behavioural science is unlikely to change the world without a heterogeneity revolution

被引:289
作者
Bryan, Christopher J. [1 ]
Tipton, Elizabeth [2 ]
Yeager, David S. [1 ]
机构
[1] Univ Texas Austin, Austin, TX 78712 USA
[2] Northwestern Univ, Evanston, IL 60208 USA
关键词
CONTEXTUAL SENSITIVITY; INTERVENTIONS; CREDIBILITY; SAMPLE; POWER; GAP;
D O I
10.1038/s41562-021-01143-3
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Behavioural science increasingly informs policy, but findings are not always replicated. Bryan et al. describe an emerging heterogeneity revolution. They recommend that researchers use heterogeneity in treatment effects to develop more robust theories of causality and strengthen the field. In the past decade, behavioural science has gained influence in policymaking but suffered a crisis of confidence in the replicability of its findings. Here, we describe a nascent heterogeneity revolution that we believe these twin historical trends have triggered. This revolution will be defined by the recognition that most treatment effects are heterogeneous, so the variation in effect estimates across studies that defines the replication crisis is to be expected as long as heterogeneous effects are studied without a systematic approach to sampling and moderation. When studied systematically, heterogeneity can be leveraged to build more complete theories of causal mechanism that could inform nuanced and dependable guidance to policymakers. We recommend investment in shared research infrastructure to make it feasible to study behavioural interventions in heterogeneous and generalizable samples, and suggest low-cost steps researchers can take immediately to avoid being misled by heterogeneity and begin to learn from it instead.
引用
收藏
页码:980 / 989
页数:10
相关论文
共 120 条
  • [1] Estimating the reproducibility of psychological science
    Aarts, Alexander A.
    Anderson, Joanna E.
    Anderson, Christopher J.
    Attridge, Peter R.
    Attwood, Angela
    Axt, Jordan
    Babel, Molly
    Bahnik, Stepan
    Baranski, Erica
    Barnett-Cowan, Michael
    Bartmess, Elizabeth
    Beer, Jennifer
    Bell, Raoul
    Bentley, Heather
    Beyan, Leah
    Binion, Grace
    Borsboom, Denny
    Bosch, Annick
    Bosco, Frank A.
    Bowman, Sara D.
    Brandt, Mark J.
    Braswell, Erin
    Brohmer, Hilmar
    Brown, Benjamin T.
    Brown, Kristina
    Bruening, Jovita
    Calhoun-Sauls, Ann
    Callahan, Shannon P.
    Chagnon, Elizabeth
    Chandler, Jesse
    Chartier, Christopher R.
    Cheung, Felix
    Christopherson, Cody D.
    Cillessen, Linda
    Clay, Russ
    Cleary, Hayley
    Cloud, Mark D.
    Cohn, Michael
    Cohoon, Johanna
    Columbus, Simon
    Cordes, Andreas
    Costantini, Giulio
    Alvarez, Leslie D. Cramblet
    Cremata, Ed
    Crusius, Jan
    DeCoster, Jamie
    DeGaetano, Michelle A.
    Della Penna, Nicolas
    den Bezemer, Bobby
    Deserno, Marie K.
    [J]. SCIENCE, 2015, 349 (6251)
  • [2] Reexamining the "Racial Gap" in Political Knowledge
    Abrajano, Marisa
    [J]. JOURNAL OF POLITICS, 2015, 77 (01) : 44 - 54
  • [3] Afif Zeina., 2018, Behavioral Science around the World: Profiles of 10 Countries'
  • [4] Alexander, 2019, LINKS 12 19 SLATE ST
  • [5] Allcott H, 2015, Q J ECON, V130, P1117, DOI 10.1093/qje/qjv015
  • [6] The Short-Run and Long-Run Effects of Behavioral Interventions: Experimental Evidence from Energy Conservation
    Allcott, Hunt
    Rogers, Todd
    [J]. AMERICAN ECONOMIC REVIEW, 2014, 104 (10) : 3003 - 3037
  • [7] Social norms and energy conservation
    Allcott, Hunt
    [J]. JOURNAL OF PUBLIC ECONOMICS, 2011, 95 (9-10) : 1082 - 1095
  • [8] Science that can change the world
    不详
    [J]. NATURE HUMAN BEHAVIOUR, 2019, 3 (06) : 539 - 539
  • [9] [Anonymous], 1964, STRUCTURE SCI REVOLU
  • [10] [Anonymous], 2020, REQUEST APPL ED RES