What does research reproducibility mean?

被引:676
作者
Goodman, Steven N. [1 ]
Fanelli, Daniele [1 ]
Ioannidis, John P. A. [1 ]
机构
[1] Stanford Univ, Meta Res Innovat Ctr Stanford METRICS, Stanford, CA 94305 USA
关键词
MEDICAL STATISTICS; REPLICATION;
D O I
10.1126/scitranslmed.aaf5027
中图分类号
Q2 [细胞生物学];
学科分类号
071009 ; 090102 ;
摘要
The language and conceptual framework of "research reproducibility" are nonstandard and unsettled across the sciences. In this Perspective, we review an array of explicit and implicit definitions of reproducibility and related terminology, and discuss how to avoid potential misunderstandings when these terms are used as a surrogate for "truth."
引用
收藏
页数:6
相关论文
共 38 条
[1]   Estimating the reproducibility of psychological science [J].
Aarts, Alexander A. ;
Anderson, Joanna E. ;
Anderson, Christopher J. ;
Attridge, Peter R. ;
Attwood, Angela ;
Axt, Jordan ;
Babel, Molly ;
Bahnik, Stepan ;
Baranski, Erica ;
Barnett-Cowan, Michael ;
Bartmess, Elizabeth ;
Beer, Jennifer ;
Bell, Raoul ;
Bentley, Heather ;
Beyan, Leah ;
Binion, Grace ;
Borsboom, Denny ;
Bosch, Annick ;
Bosco, Frank A. ;
Bowman, Sara D. ;
Brandt, Mark J. ;
Braswell, Erin ;
Brohmer, Hilmar ;
Brown, Benjamin T. ;
Brown, Kristina ;
Bruening, Jovita ;
Calhoun-Sauls, Ann ;
Callahan, Shannon P. ;
Chagnon, Elizabeth ;
Chandler, Jesse ;
Chartier, Christopher R. ;
Cheung, Felix ;
Christopherson, Cody D. ;
Cillessen, Linda ;
Clay, Russ ;
Cleary, Hayley ;
Cloud, Mark D. ;
Cohn, Michael ;
Cohoon, Johanna ;
Columbus, Simon ;
Cordes, Andreas ;
Costantini, Giulio ;
Alvarez, Leslie D. Cramblet ;
Cremata, Ed ;
Crusius, Jan ;
DeCoster, Jamie ;
DeGaetano, Michelle A. ;
Della Penna, Nicolas ;
den Bezemer, Bobby ;
Deserno, Marie K. .
SCIENCE, 2015, 349 (6251)
[2]   The Galaxy platform for accessible, reproducible and collaborative biomedical analyses: 2016 update [J].
Afgan, Enis ;
Baker, Dannon ;
van den Beek, Marius ;
Blankenberg, Daniel ;
Bouvier, Dave ;
Cech, Martin ;
Chilton, John ;
Clements, Dave ;
Coraor, Nate ;
Eberhard, Carl ;
Gruening, Bjoern ;
Guerler, Aysam ;
Hillman-Jackson, Jennifer ;
Von Kuster, Greg ;
Rasche, Eric ;
Soranzo, Nicola ;
Turaga, Nitesh ;
Taylor, James ;
Nekrutenko, Anton ;
Goecks, Jeremy .
NUCLEIC ACIDS RESEARCH, 2016, 44 (W1) :W3-W10
[3]  
[Anonymous], 1988, NEW ENGL J MED, V319, P1681
[4]   Reproducibility in Science Improving the Standard for Basic and Preclinical Research [J].
Begley, C. Glenn ;
Ioannidis, John P. A. .
CIRCULATION RESEARCH, 2015, 116 (01) :116-126
[5]  
Begley C Glenn, 2013, Am Soc Clin Oncol Educ Book, P466, DOI 10.1200/EdBook_AM.2013.33.466
[6]   Multiplicities in Cancer Research: Ubiquitous and Necessary Evils [J].
Berry, Donald .
JOURNAL OF THE NATIONAL CANCER INSTITUTE, 2012, 104 (15) :1124-1132
[7]  
Bollen K., 2015, technical report
[8]   P-Value Precision and Reproducibility [J].
Boos, Dennis D. ;
Stefanski, Leonard A. .
AMERICAN STATISTICIAN, 2011, 65 (04) :213-221
[9]   Empirical evidence for selective reporting of outcomes in randomized trials -: Comparison of Protocols to published articles [J].
Chan, AW ;
Hróbjartsson, A ;
Haahr, MT ;
Gotzsche, PC ;
Altman, DG .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2004, 291 (20) :2457-2465
[10]  
Claerbout J.F., 1992, ELECT DOCUMENTS GIVE, P601, DOI [10.1190/1.1822162, DOI 10.1190/1.1822162]