Redefine or justify? Comments on the alpha debate

被引:14
作者
de Ruiter, Jan [1 ,2 ]
机构
[1] Tufts Univ, Dept Comp Sci, 490 Boston Ave, Medford, MA 02155 USA
[2] Tufts Univ, Dept Psychol, 490 Boston Ave, Medford, MA 02155 USA
关键词
Significance; Reproducibility; Alpha; Evidence;
D O I
10.3758/s13423-018-1523-9
中图分类号
B841 [心理学研究方法];
学科分类号
040201 ;
摘要
Benjamin et al. (Nature Human Behaviour 2, 6-10, 2017) proposed improving the reproducibility of findings in psychological research by lowering the alpha level of our conventional null hypothesis significance tests from .05 to .005, because findings with p-values close to .05 represent insufficient empirical evidence. They argued that findings with a p-value between 0.005 and 0.05 should still be published, but not called significant anymore. This proposal was criticized and rejected in a response by Lakens et al. (Nature Human Behavior 2, 168-171, 2018), who argued that instead of lowering the traditional alpha threshold to .005, we should stop using the term statistically significant, and require researchers to determine and justify their alpha levels before they collect data. In this contribution, I argue that the arguments presented by Lakens et al. against the proposal by Benjamin et al. are not convincing. Thus, given that it is highly unlikely that our field will abandon the NHST paradigm any time soon, lowering our alpha level to .005 is at this moment the best way to combat the replication crisis in psychology.
引用
收藏
页码:430 / 433
页数:4
相关论文
共 11 条
[1]   Estimating the reproducibility of psychological science [J].
Aarts, Alexander A. ;
Anderson, Joanna E. ;
Anderson, Christopher J. ;
Attridge, Peter R. ;
Attwood, Angela ;
Axt, Jordan ;
Babel, Molly ;
Bahnik, Stepan ;
Baranski, Erica ;
Barnett-Cowan, Michael ;
Bartmess, Elizabeth ;
Beer, Jennifer ;
Bell, Raoul ;
Bentley, Heather ;
Beyan, Leah ;
Binion, Grace ;
Borsboom, Denny ;
Bosch, Annick ;
Bosco, Frank A. ;
Bowman, Sara D. ;
Brandt, Mark J. ;
Braswell, Erin ;
Brohmer, Hilmar ;
Brown, Benjamin T. ;
Brown, Kristina ;
Bruening, Jovita ;
Calhoun-Sauls, Ann ;
Callahan, Shannon P. ;
Chagnon, Elizabeth ;
Chandler, Jesse ;
Chartier, Christopher R. ;
Cheung, Felix ;
Christopherson, Cody D. ;
Cillessen, Linda ;
Clay, Russ ;
Cleary, Hayley ;
Cloud, Mark D. ;
Cohn, Michael ;
Cohoon, Johanna ;
Columbus, Simon ;
Cordes, Andreas ;
Costantini, Giulio ;
Alvarez, Leslie D. Cramblet ;
Cremata, Ed ;
Crusius, Jan ;
DeCoster, Jamie ;
DeGaetano, Michelle A. ;
Della Penna, Nicolas ;
den Bezemer, Bobby ;
Deserno, Marie K. .
SCIENCE, 2015, 349 (6251)
[2]  
[Anonymous], NATURE HUMAN BEHAV
[3]   The Rules of the Game Called Psychological Science [J].
Bakker, Marjan ;
van Dijk, Annette ;
Wicherts, Jelte M. .
PERSPECTIVES ON PSYCHOLOGICAL SCIENCE, 2012, 7 (06) :543-554
[4]   A Bayesian Perspective on the Reproducibility Project: Psychology [J].
Etz, Alexander ;
Vandekerckhove, Joachim .
PLOS ONE, 2016, 11 (02)
[5]  
Held L., ANN REV STAT ITS APP
[6]   On the Reproducibility of Psychological Science [J].
Johnson, Valen E. ;
Payne, Richard D. ;
Wang, Tianying ;
Asher, Alex ;
Mandal, Soutrik .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2017, 112 (517) :1-10
[7]   Justify your alpha [J].
Lakens, Daniel ;
Adolfi, Federico G. ;
Albers, Casper J. ;
Anvari, Farid ;
Apps, Matthew A. J. ;
Argamon, Shlomo E. ;
Baguley, Thom ;
Becker, Raymond B. ;
Benning, Stephen D. ;
Bradford, Daniel E. ;
Buchanan, Erin M. ;
Caldwell, Aaron R. ;
Van Calster, Ben ;
Carlsson, Rickard ;
Chen, Sau-Chin ;
Chung, Bryan ;
Colling, Lincoln J. ;
Collins, Gary S. ;
Crook, Zander ;
Cross, Emily S. ;
Daniels, Sameera ;
Danielsson, Henrik ;
DeBruine, Lisa ;
Dunleavy, Daniel J. ;
Earp, Brian D. ;
Feist, Michele I. ;
Ferrell, Jason D. ;
Field, James G. ;
Fox, Nicholas W. ;
Friesen, Amanda ;
Gomes, Caio ;
Gonzalez-Marquez, Monica ;
Grange, James A. ;
Grieve, Andrew P. ;
Guggenberger, Robert ;
Grist, James ;
van Harmelen, Anne-Laura ;
Hasselman, Fred ;
Hochard, Kevin D. ;
Hoffarth, Mark R. ;
Holmes, Nicholas P. ;
Ingre, Michael ;
Isager, Peder M. ;
Isotalus, Hanna K. ;
Johansson, Christer ;
Juszczyk, Konrad ;
Kenny, David A. ;
Khalil, Ahmed A. ;
Konat, Barbara ;
Lao, Junpeng .
NATURE HUMAN BEHAVIOUR, 2018, 2 (03) :168-171
[8]  
Morey R, 2017, REDEFINING STAT SIGN
[9]  
Royall RM, 1997, Statistical Evidence: A likelihood paradigm, V1st
[10]  
Wilson B. M., 2018, ADV METHODS PRACTICE