Indices of Effect Existence and Significance in the Bayesian Framework

被引:539
作者
Makowski, Dominique [1 ]
Ben-Shachar, Mattan S. [2 ]
Chen, S. H. Annabel [1 ,3 ,4 ]
Luedecke, Daniel [5 ]
机构
[1] Nanyang Technol Univ, Sch Social Sci, Singapore, Singapore
[2] Ben Gurion Univ Negev, Dept Psychol, Beer Sheva, Israel
[3] Nanyang Technol Univ, Ctr Res & Dev Learning, Singapore, Singapore
[4] Nanyang Technol Univ, Lee Kong Chian Sch Med, Singapore, Singapore
[5] Univ Med Ctr Hamburg Eppendorf, Dept Med Sociol, Hamburg, Germany
关键词
Bayesian; significance; NHST; p-value; Bayes factors; CONFIDENCE-INTERVALS; PARAMETER-ESTIMATION; P-VALUES; T TESTS; PSYCHOLOGY; INFERENCE; FAILURE; REFORM; TIME;
D O I
10.3389/fpsyg.2019.02767
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Turmoil has engulfed psychological science. Causes and consequences of the reproducibility crisis are in dispute. With the hope of addressing some of its aspects, Bayesian methods are gaining increasing attention in psychological science. Some of their advantages, as opposed to the frequentist framework, are the ability to describe parameters in probabilistic terms and explicitly incorporate prior knowledge about them into the model. These issues are crucial in particular regarding the current debate about statistical significance. Bayesian methods are not necessarily the only remedy against incorrect interpretations or wrong conclusions, but there is an increasing agreement that they are one of the keys to avoid such fallacies. Nevertheless, its flexible nature is its power and weakness, for there is no agreement about what indices of "significance" should be computed or reported. This lack of a consensual index or guidelines, such as the frequentist p-value, further contributes to the unnecessary opacity that many non-familiar readers perceive in Bayesian statistics. Thus, this study describes and compares several Bayesian indices, provide intuitive visual representation of their "behavior" in relationship with common sources of variance such as sample size, magnitude of effects and also frequentist significance. The results contribute to the development of an intuitive understanding of the values that researchers report, allowing to draw sensible recommendations for Bayesian statistics description, critical for the standardization of scientific reporting.
引用
收藏
页数:14
相关论文
共 63 条
[1]   Retire statistical significance [J].
Amrhein, Valentin ;
Greenland, Sander ;
McShane, Blake .
NATURE, 2019, 567 (7748) :305-307
[2]   Null hypothesis testing: Problems, prevalence, and an alternative [J].
Anderson, DR ;
Burnham, KP ;
Thompson, WL .
JOURNAL OF WILDLIFE MANAGEMENT, 2000, 64 (04) :912-923
[3]   Prior approval: The growth of Bayesian methods in psychology [J].
Andrews, Mark ;
Baguley, Thom .
BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY, 2013, 66 (01) :1-7
[4]  
[Anonymous], ANOTHER STAT PARADOX
[5]  
[Anonymous], 2019, RSTANARM BAYESIAN AP
[6]  
[Anonymous], 1998, THEORY PROBABILITY
[7]  
[Anonymous], 2017, Psychological science under scrutiny, DOI [DOI 10.1002/9781119095910.CH8, 10.1002/9781119095910.ch8]
[8]  
[Anonymous], 2014, HDB REGIONAL SCI, DOI [10.1007/978-3-642-23430-9_89, DOI 10.1007/978-3-642-23430-9_89]
[9]  
[Anonymous], BAYESIAN INFERENCE T
[10]  
[Anonymous], 2018, Statistical Rethinking