On the past and future of null hypothesis significance testing

被引:52
作者
Robinson, DH [1 ]
Wainer, H
机构
[1] Univ Texas, Dept Educ Psychol, Austin, TX 78712 USA
[2] Natl Board Med Examiners, Philadelphia, PA 19104 USA
关键词
Bayesian statistics; effect sizes; null hypothesis testing; P-values; significance testing; statistical significance testing;
D O I
10.2307/3803158
中图分类号
Q14 [生态学(生物生态学)];
学科分类号
071012 ; 0713 ;
摘要
Recent criticisms of null hypothesis significance testing (NHST) have appeared in wildlife research journals (Cherry 1998; Johnson 1999; Anderson et al. 2000, 2001; Guthery et al. 2001). In this essay, we discuss these criticisms with regard to both current usage of NHST and plausible future use. We suggest that tire historical use of such procedures was reasonable and that current users might spend time profitably reading some of Fisher's applied work. However, modifications to NHST, and to the interpretations of its outcomes, might better suit the needs of modern science. Our primary conclusion is that NHST most often is useful as an adjunct to other results (e.g., effect sizes) rather than as a stand-alone result. We cite some examples, however, where NHST can be profitably used alone. Last, we find considerable experimental support for a less dogmatic attitude toward the interpretation of the probability yielded from such procedures.
引用
收藏
页码:263 / 271
页数:9
相关论文
共 50 条
[21]   Perspectives on the Use of Null Hypothesis Statistical Testing. Part II: Is Null Hypothesis Statistical Testing an Irregular Bulk of Masonry? [J].
Marmolejo-Ramos, Fernando ;
Cousineau, Denis .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2017, 77 (04) :613-615
[22]   Teaching Bayesian Parameter Estimation, Bayesian Model Comparison and Null Hypothesis Significance Testing Using Spreadsheets [J].
Fisher, Christopher R. ;
Wolfe, Christopher R. .
SPREADSHEETS IN EDUCATION, 2012, 5 (03)
[23]   A Review of Issues About Null Hypothesis Bayesian Testing [J].
Tendeiro, Jorge N. ;
Kiers, Henk A. L. .
PSYCHOLOGICAL METHODS, 2019, 24 (06) :774-795
[24]   Null Hypothesis Significance Testing Interpreted and Calibrated by Estimating Probabilities of Sign Errors: A Bayes-Frequentist Continuum [J].
Bickel, David R. .
AMERICAN STATISTICIAN, 2020, 75 (01) :104-112
[25]   Perspectives on the Use of Null Hypothesis Statistical Testing. Part III: The Various Nuts and Bolts of Statistical and Hypothesis Testing [J].
Marmolejo-Ramos, Fernando ;
Cousineau, Denis .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2017, 77 (05) :816-818
[26]   Why checking model assumptions using null hypothesis significance tests does not suffice: A plea for plausibility [J].
Tijmstra, Jesper .
PSYCHONOMIC BULLETIN & REVIEW, 2018, 25 (02) :548-559
[27]   Moving beyond traditional null hypothesis testing: evaluating expectations directly [J].
Van de Schoot, Rens ;
Hoijtink, Herbert ;
Jan-Willem, Romeijn .
FRONTIERS IN PSYCHOLOGY, 2011, 2
[28]   fbst: An R package for the Full Bayesian Significance Test for testing a sharp null hypothesis against its alternative via the e value [J].
Kelter, Riko .
BEHAVIOR RESEARCH METHODS, 2022, 54 (03) :1114-1130
[29]   A suitable Bayesian approach in testing point null hypothesis:: Some examples revisited [J].
Gómez-Villegas, MA ;
Main, P ;
Sanz, L .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2002, 31 (02) :201-217
[30]   ε-contaminated priors in testing point null hypothesis:: a procedure to determine the prior probability [J].
Gómez-Villegas, MA ;
Sanz, L .
STATISTICS & PROBABILITY LETTERS, 2000, 47 (01) :53-60