A Replication Study of Operations Management Experiments in Management Science

被引:13
作者
Davis, Andrew M. [1 ]
Flicker, Blair [2 ]
Hyndman, Kyle [3 ]
Katok, Elena [3 ]
Keppler, Samantha [4 ]
Leider, Stephen [4 ]
Long, Xiaoyang [5 ]
Tong, Jordan D. [5 ]
机构
[1] Cornell Univ, Samuel Curtis Johnson Grad Sch Management, Ithaca, NY 14853 USA
[2] Univ South Carolina, Darla Moore Sch Business, Columbia, SC 29208 USA
[3] Univ Texas Dallas, Naveen Jindal Sch Management, Richardson, TX 75080 USA
[4] Univ Michigan, Ross Sch Business, Ann Arbor, MI 48109 USA
[5] Univ Wisconsin Madison, Wisconsin Sch Business, Madison, WI 53706 USA
关键词
replication; operations management; experiments; management science replication project; INFORMATION;
D O I
10.1287/mnsc.2023.4866
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
Over the last two decades, researchers in operations management have increasingly leveraged laboratory experiments to identify key behavioral insights. These experiments inform behavioral theories of operations management, impacting domains including inventory, supply chain management, queuing, forecasting, and sourcing. Yet, until now, the replicability of most behavioral insights from these laboratory experiments has been untested. We remedy this with the first large-scale replication study in operations management. With the input of the wider operations management community, we identify 10 prominent experimental operations management papers published in Management Science, which span a variety of domains, to be the focus of our replication effort. For each paper, we conduct a high-powered replication study of the main results across multiple locations using original materials (when available and suitable). In addition, our study tests replicability in multiple modalities (in-person and online) due to laboratory closures during the COVID-19 pandemic. Our replication study contributes new knowledge about the robustness of several key behavioral theories in operations management and contributes more broadly to efforts in the operations management field to improve research transparency and reliability.
引用
收藏
页码:4977 / 4991
页数:16
相关论文
共 28 条
  • [1] Estimating the reproducibility of psychological science
    Aarts, Alexander A.
    Anderson, Joanna E.
    Anderson, Christopher J.
    Attridge, Peter R.
    Attwood, Angela
    Axt, Jordan
    Babel, Molly
    Bahnik, Stepan
    Baranski, Erica
    Barnett-Cowan, Michael
    Bartmess, Elizabeth
    Beer, Jennifer
    Bell, Raoul
    Bentley, Heather
    Beyan, Leah
    Binion, Grace
    Borsboom, Denny
    Bosch, Annick
    Bosco, Frank A.
    Bowman, Sara D.
    Brandt, Mark J.
    Braswell, Erin
    Brohmer, Hilmar
    Brown, Benjamin T.
    Brown, Kristina
    Bruening, Jovita
    Calhoun-Sauls, Ann
    Callahan, Shannon P.
    Chagnon, Elizabeth
    Chandler, Jesse
    Chartier, Christopher R.
    Cheung, Felix
    Christopherson, Cody D.
    Cillessen, Linda
    Clay, Russ
    Cleary, Hayley
    Cloud, Mark D.
    Cohn, Michael
    Cohoon, Johanna
    Columbus, Simon
    Cordes, Andreas
    Costantini, Giulio
    Alvarez, Leslie D. Cramblet
    Cremata, Ed
    Crusius, Jan
    DeCoster, Jamie
    DeGaetano, Michelle A.
    Della Penna, Nicolas
    den Bezemer, Bobby
    Deserno, Marie K.
    [J]. SCIENCE, 2015, 349 (6251)
  • [2] Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects
    Anderson, Michael L.
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2008, 103 (484) : 1481 - 1495
  • [3] Adaptive linear step-up procedures that control the false discovery rate
    Benjamini, Yoav
    Krieger, Abba M.
    Yekutieli, Daniel
    [J]. BIOMETRIKA, 2006, 93 (03) : 491 - 507
  • [4] Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015
    Camerer, Colin F.
    Dreber, Anna
    Holzmeister, Felix
    Ho, Teck-Hua
    Huber, Juegen
    Johannesson, Magnus
    Kirchler, Michael
    Nave, Gideon
    Nosek, Brian A.
    Pfeiffer, Thomas
    Altmejd, Adam
    Buttrick, Nick
    Chan, Taizan
    Chen, Yiling
    Forsell, Eskil
    Gampa, Anup
    Heikensten, Emma
    Hummer, Lily
    Imai, Taisuke
    Isaksson, Siri
    Manfredi, Dylan
    Rose, Julia
    Wagenmakers, Eric-Jan
    Wu, Hang
    [J]. NATURE HUMAN BEHAVIOUR, 2018, 2 (09): : 637 - 644
  • [5] Evaluating replicability of laboratory experiments in economics
    Camerer, Colin F.
    Dreber, Anna
    Forsell, Eskil
    Ho, Teck-Hua
    Huber, Juergen
    Johannesson, Magnus
    Kirchler, Michael
    Almenberg, Johan
    Altmejd, Adam
    Chan, Taizan
    Heikensten, Emma
    Holzmeister, Felix
    Imai, Taisuke
    Isaksson, Siri
    Nave, Gideon
    Pfeiffer, Thomas
    Razen, Michael
    Wu, Hang
    [J]. SCIENCE, 2016, 351 (6280) : 1433 - 1436
  • [6] The Effect of Payment Schemes on Inventory Decisions: The Role of Mental Accounting
    Chen, Li
    Koek, A. Guerhan
    Tong, Jordan D.
    [J]. MANAGEMENT SCIENCE, 2013, 59 (02) : 436 - 451
  • [7] Best practices in replication: a case study of common information in coordination games
    Chen, Roy
    Chen, Yan
    Riyanto, Yohanes E.
    [J]. EXPERIMENTAL ECONOMICS, 2021, 24 (01) : 2 - 30
  • [8] Behavioral causes of the bullwhip effect and the observed value of inventory information
    Croson, R
    Donohue, K
    [J]. MANAGEMENT SCIENCE, 2006, 52 (03) : 323 - 336
  • [9] Do Auctioneers Pick Optimal Reserve Prices?
    Davis, Andrew M.
    Katok, Elena
    Kwasnica, Anthony M.
    [J]. MANAGEMENT SCIENCE, 2011, 57 (01) : 177 - 192
  • [10] Predict science to improve science
    DellaVigna, Stefano
    Pope, Devin
    Vivalt, Eva
    [J]. SCIENCE, 2019, 366 (6464) : 428 - 429