The p-Value Debate and Statistical (Mal)practice-Implications for the Agricultural and Food Economics Community

被引:16
作者
Heckelei, Thomas [1 ]
Huettel, Silke [2 ]
Odening, Martin [3 ]
Rommel, Jens [4 ]
机构
[1] Univ Bonn, Bonn, Germany
[2] Univ Gottingen, Gottingen, Germany
[3] Humboldt Univ, Berlin, Germany
[4] Swedish Univ Agr Sci, Uppsala, Sweden
来源
GERMAN JOURNAL OF AGRICULTURAL ECONOMICS | 2023年 / 72卷 / 01期
关键词
statistical inference; p-hacking; publication bias; replication crisis; pre-registration; STANDARD ERROR; POWER; TRANSPARENCY; REPLICABILITY; STATEMENT; TESTS; BIAS;
D O I
10.30430/gjae.2023.0231
中图分类号
F3 [农业经济];
学科分类号
0202 ; 020205 ; 1203 ;
摘要
A vivid debate is ongoing in the scientific community about statistical malpractice and the related publica-tion bias. No general consensus exists on the conse-quences and this is reflected in heterogeneous rules defined by scientific journals on the use and reporting of statistical inference. This paper aims at providing an overview on the debate, discussing how it is per-ceived by the agricultural economics community, and deriving implications for our roles as researchers, contributors to the scientific publication process, and teachers. Following a 'Mixed Methods Review', we start by summarizing the current state of the p-value debate in the context of the replication crisis and commonly applied statistical practices in our commu-nity. This is followed by motivation, design, results and discussion of an explorative and descriptive sur-vey on statistical knowledge and practice among the researchers in the agricultural economics community in Austria, Germany and Switzerland. Instead of providing specific guidelines or rules, we derive im-plications for our roles in the scientific process to support a needed long-term cultural change regarding empirical scientific practices. Acceptance of scientific work should largely be based on the theoretical and methodological rigor and where the perceived rele-vance arises from the questions asked, the methodolo-gy employed, and the data used but not from the re-sults generated. Revised and clear journal guidelines, the creation of resources for teaching and research, and public recognition of good practice are suggested measures to move forward.
引用
收藏
页码:47 / 67
页数:21
相关论文
共 89 条
[1]  
AAEA (Agricultural & Applied Association), 2021, CALL PAP SPEC ISS RE
[2]   Discussion points for Bayesian inference [J].
Aczel, Balazs ;
Hoekstra, Rink ;
Gelman, Andrew ;
Wagenmakers, Eric-Jan ;
Klugkist, Irene G. ;
Rouder, Jeffrey N. ;
Vandekerckhove, Joachim ;
Lee, Michael D. ;
Morey, Richard D. ;
Vanpaemel, Wolf ;
Dienes, Zoltan ;
van Ravenzwaaij, Don .
NATURE HUMAN BEHAVIOUR, 2020, 4 (06) :561-563
[4]   STATISTICS NOTES - ABSENCE OF EVIDENCE IS NOT EVIDENCE OF ABSENCE [J].
ALTMAN, DG ;
BLAND, JM .
BRITISH MEDICAL JOURNAL, 1995, 311 (7003) :485-485
[5]   Retire statistical significance [J].
Amrhein, Valentin ;
Greenland, Sander ;
McShane, Blake .
NATURE, 2019, 567 (7748) :305-307
[6]   The earth is flat (p > 0.05): significance thresholds and the crisis of unreplicable research [J].
Amrhein, Valentin ;
Korner-Nievergelt, Franzi ;
Roth, Tobias .
PEERJ, 2017, 5
[7]  
Angrist JD, 2009, MOSTLY HARMLESS ECONOMETRICS: AN EMPIRICISTS COMPANION, P1
[8]  
ARPINON T., 2022, PRACTICAL GUIDE REGI
[9]   The Significance of Data-Sharing Policy [J].
Askarov, Zohid ;
Doucouliagos, Anthony ;
Doucouliagos, Hristos ;
Stanley, T. D. .
JOURNAL OF THE EUROPEAN ECONOMIC ASSOCIATION, 2023, 21 (03) :1191-1226
[10]   Ensuring the quality and specificity of preregistrations [J].
Bakker, Marjan ;
Veldkamp, Coosje L. S. ;
van Assen, Marcel A. L. M. ;
Crompvoets, Elise A., V ;
Ong, How Hwee ;
Nosek, Brian A. ;
Soderberg, Courtney K. ;
Mellor, David ;
Wicherts, Jelte M. .
PLOS BIOLOGY, 2020, 18 (12)