On the past and future of null hypothesis significance testing

被引:52
作者
Robinson, DH [1 ]
Wainer, H
机构
[1] Univ Texas, Dept Educ Psychol, Austin, TX 78712 USA
[2] Natl Board Med Examiners, Philadelphia, PA 19104 USA
关键词
Bayesian statistics; effect sizes; null hypothesis testing; P-values; significance testing; statistical significance testing;
D O I
10.2307/3803158
中图分类号
Q14 [生态学(生物生态学)];
学科分类号
071012 ; 0713 ;
摘要
Recent criticisms of null hypothesis significance testing (NHST) have appeared in wildlife research journals (Cherry 1998; Johnson 1999; Anderson et al. 2000, 2001; Guthery et al. 2001). In this essay, we discuss these criticisms with regard to both current usage of NHST and plausible future use. We suggest that tire historical use of such procedures was reasonable and that current users might spend time profitably reading some of Fisher's applied work. However, modifications to NHST, and to the interpretations of its outcomes, might better suit the needs of modern science. Our primary conclusion is that NHST most often is useful as an adjunct to other results (e.g., effect sizes) rather than as a stand-alone result. We cite some examples, however, where NHST can be profitably used alone. Last, we find considerable experimental support for a less dogmatic attitude toward the interpretation of the probability yielded from such procedures.
引用
收藏
页码:263 / 271
页数:9
相关论文
共 50 条
[31]   Researchers Should Make Thoughtful Assessments Instead of Null-Hypothesis Significance Tests [J].
Schwab, Andreas ;
Abrahamson, Eric ;
Starbuck, William H. ;
Fidler, Fiona .
ORGANIZATION SCIENCE, 2011, 22 (04) :1105-1120
[32]   Testing Significance Testing [J].
Krueger, Joachim, I ;
Heck, Patrick R. .
COLLABRA-PSYCHOLOGY, 2018, 4 (01)
[33]   Misinterpreting p: The Discrepancy Between p Values and the Probability the Null Hypothesis is True, the Influence of Multiple Testing, and Implications for the Replication Crisis [J].
Anderson, Samantha F. .
PSYCHOLOGICAL METHODS, 2020, 25 (05) :596-609
[34]   Data analysis in forest sciences: why do we continue using null hypothesis significance tests? [J].
Estay, Sergio A. ;
Naulin, Paulette I. .
BOSQUE, 2011, 32 (01) :3-9
[35]   Regression-Equivalent Effect Sizes for Latent Growth Modeling and Associated Null Hypothesis Significance Tests [J].
Feingold, Alan .
STRUCTURAL EQUATION MODELING-A MULTIDISCIPLINARY JOURNAL, 2023, 30 (04) :672-685
[36]   Why checking model assumptions using null hypothesis significance tests does not suffice: A plea for plausibility [J].
Jesper Tijmstra .
Psychonomic Bulletin & Review, 2018, 25 :548-559
[37]   A reconceptualization of significance testing [J].
Perezgonzalez, Jose D. .
THEORY & PSYCHOLOGY, 2014, 24 (06) :852-859
[38]   Manipulating the Alpha Level Cannot Cure Significance Testing [J].
Trafimow, David ;
Amrhein, Valentin ;
Areshenkoff, Corson N. ;
Barrera-Causil, Carlos J. ;
Beh, Eric J. ;
Bilgic, Yusuf K. ;
Bono, Roser ;
Bradley, Michael T. ;
Briggs, William M. ;
Cepeda-Freyre, Hector A. ;
Chaigneau, Sergio E. ;
Ciocca, Daniel R. ;
Correa, Juan C. ;
Cousineau, Denis ;
de Boer, Michiel R. ;
Dhar, Subhra S. ;
Dolgov, Igor ;
Gomez-Benito, Juana ;
Grendar, Marian ;
Grice, James W. ;
Guerrero-Gimenez, Martin E. ;
Gutierrez, Andres ;
Huedo-Medina, Tania B. ;
Jaffe, Klaus ;
Janyan, Armina ;
Karimnezhad, Ali ;
Korner-Nievergelt, Franzi ;
Kosugi, Koji ;
Lachmair, Martin ;
Ledesma, Ruben D. ;
Limongi, Roberto ;
Liuzza, Marco T. ;
Lombardo, Rosaria ;
Marks, Michael J. ;
Meinlschmidt, Gunther ;
Nalborczyk, Ladislas ;
Nguyen, Hung T. ;
Ospina, Raydonal ;
Perezgonzalez, Jose D. ;
Pfister, Roland ;
Rahona, Juan J. ;
Rodriguez-Medina, David A. ;
Romao, Xavier ;
Ruiz-Fernandez, Susana ;
Suarez, Isabel ;
Tegethoff, Marion ;
Tejo, Mauricio ;
van de Schoot, Rens ;
Vankov, Ivan I. ;
Velasco-Forero, Santiago .
FRONTIERS IN PSYCHOLOGY, 2018, 9
[39]   Perspectives on the Use of Null Hypothesis Statistical Testing. Part I: The Mighty Frames of Scientific and Statistical Inference [J].
Marmolejo-Ramos, Fernando ;
Cousineau, Denis .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2017, 77 (03) :471-474
[40]   A Gentle Introduction to the Comparison Between Null Hypothesis Testing and Bayesian Analysis: Reanalysis of Two Randomized Controlled Trials [J].
Bendtsen, Marcus .
JOURNAL OF MEDICAL INTERNET RESEARCH, 2018, 20 (10)