Improving Psychological Science through Transparency and Openness: An Overview

被引:49
作者
Hales, Andrew H. [1 ]
Wesselmann, Eric D. [2 ]
Hilgard, Joseph [2 ]
机构
[1] Univ Virginia, Frank Batten Sch Publ Policy & Leadership, Charlottesville, VA 22902 USA
[2] Illinois State Univ, Dept Psychol, Normal, IL 61790 USA
关键词
Replication; Reproducibility; Preregistration; Meta-analysis; STATISTICAL-INFERENCE; BEHAVIOR ANALYSIS; REPLICATION; REPLICABILITY; POWER; RECOMMENDATIONS; CONSEQUENCES; METAANALYSIS; INCENTIVES; REJECTION;
D O I
10.1007/s40614-018-00186-8
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
The ability to independently verify and replicate observations made by other researchers is a hallmark of science. In this article, we provide an overview of recent discussions concerning replicability and best practices in mainstream psychology with an emphasis on the practical benefists to both researchers and the field as a whole. We first review challenges individual researchers face in producing research that is both publishable and reliable. We then suggest methods for producing more accurate research claims, such as transparently disclosing how results were obtained and analyzed, preregistering analysis plans, and publicly posting original data and materials. We also discuss ongoing changes at the institutional level to incentivize stronger research. These include officially recognizing open science practices at the journal level, disconnecting the publication decision from the results of a study, training students to conduct replications, and publishing replications. We conclude that these open science practices afford exciting low-cost opportunities to improve the quality of psychological science.
引用
收藏
页码:13 / 31
页数:19
相关论文
共 96 条
[1]   Estimating the reproducibility of psychological science [J].
Aarts, Alexander A. ;
Anderson, Joanna E. ;
Anderson, Christopher J. ;
Attridge, Peter R. ;
Attwood, Angela ;
Axt, Jordan ;
Babel, Molly ;
Bahnik, Stepan ;
Baranski, Erica ;
Barnett-Cowan, Michael ;
Bartmess, Elizabeth ;
Beer, Jennifer ;
Bell, Raoul ;
Bentley, Heather ;
Beyan, Leah ;
Binion, Grace ;
Borsboom, Denny ;
Bosch, Annick ;
Bosco, Frank A. ;
Bowman, Sara D. ;
Brandt, Mark J. ;
Braswell, Erin ;
Brohmer, Hilmar ;
Brown, Benjamin T. ;
Brown, Kristina ;
Bruening, Jovita ;
Calhoun-Sauls, Ann ;
Callahan, Shannon P. ;
Chagnon, Elizabeth ;
Chandler, Jesse ;
Chartier, Christopher R. ;
Cheung, Felix ;
Christopherson, Cody D. ;
Cillessen, Linda ;
Clay, Russ ;
Cleary, Hayley ;
Cloud, Mark D. ;
Cohn, Michael ;
Cohoon, Johanna ;
Columbus, Simon ;
Cordes, Andreas ;
Costantini, Giulio ;
Alvarez, Leslie D. Cramblet ;
Cremata, Ed ;
Crusius, Jan ;
DeCoster, Jamie ;
DeGaetano, Michelle A. ;
Della Penna, Nicolas ;
den Bezemer, Bobby ;
Deserno, Marie K. .
SCIENCE, 2015, 349 (6251)
[2]  
[Anonymous], 2013, Social Psychology, DOI [10.1027/1864-9335/a000143, DOI 10.1027/1864-9335/A000143]
[3]  
[Anonymous], PREREGISTRATION REVO
[4]  
[Anonymous], 1995, Statistics as principled argument
[5]  
[Anonymous], METAANALYSIS SINGLE
[6]  
[Anonymous], 1952, Science and Method
[7]  
Baron A., 1998, HDB RES METHODS HUMA, P45, DOI [10.1007/978-1-4899-1947-23, DOI 10.1007/978-1-4899-1947-23, 10.1007/978-1-4899-1947-2_3, DOI 10.1007/978-1-4899-1947-2_3]
[9]   Malignant side effects of null-hypothesis significance testing [J].
Branch, Marc .
THEORY & PSYCHOLOGY, 2014, 24 (02) :256-277
[10]   The "Reproducibility Crisis:" Might the Methods Used Frequently in Behavior-Analysis Research Help? [J].
Branch, Marc N. .
PERSPECTIVES ON BEHAVIOR SCIENCE, 2019, 42 (01) :77-89