Frequentist Model-based Statistical Induction and the Replication Crisis

被引:2
|
作者
Spanos, Aris [1 ]
机构
[1] Virginia Tech, Dept Econ, Blacksburg, VA 24061 USA
关键词
Fisher's model-based induction; Statistical misspecification; Duhem's conundrum; Statistical vs. substantive information/model/adequacy; Trustworthy evidence; Misspecification testing; Replicability; Respecification; Modeling vs. inference; Statistical results vs. empirical evidence; Induction vs. deduction vs. abduction; RELIABILITY; INFERENCE;
D O I
10.1007/s40953-022-00312-z
中图分类号
F [经济];
学科分类号
02 ;
摘要
The prevailing view in the current replication crisis literature is that the non-replicability of published empirical studies (a) confirms their untrustworthiness, and (b) the primary source of that is the abuse of frequentist testing, in general, and the p-value in particular. The main objective of the paper is to challenge both of these claims and make a case that (a) non-replicability does not necessarily imply untrustworthiness and (b) the abuses of frequentist testing are only symptomatic of a much broader problem relating to the uninformed and recipe-like implementation of statistical modeling and inference that contributes significantly to untrustworthy evidence. It is argued that the crucial contributors to the untrustworthiness relate (directly or indirectly) to the inadequate understanding and implementation of the stipulations required for model-based statistical induction to give rise to trustworthy evidence. It is argued that these preconditions relate to securing reliable 'learning from data' about phenomena of interest and pertain to the nature, origin, and justification of genuine empirical knowledge, as opposed to beliefs, conjectures, and opinions.
引用
收藏
页码:133 / 159
页数:27
相关论文
共 50 条
  • [1] Frequentist Model-based Statistical Induction and the Replication Crisis
    Aris Spanos
    Journal of Quantitative Economics, 2022, 20 : 133 - 159
  • [2] A Statistical Model to Investigate the Reproducibility Rate Based on Replication Experiments
    Pauli, Francesco
    INTERNATIONAL STATISTICAL REVIEW, 2019, 87 (01) : 68 - 79
  • [3] Statistical model-based approaches for functional connectivity analysis of neuroimaging data
    Foti, Nicholas J.
    Fox, Emily B.
    CURRENT OPINION IN NEUROBIOLOGY, 2019, 55 : 48 - 54
  • [4] Model Learning and Model-Based Testing
    Aichernig, Bernhard K.
    Mostowski, Wojciech
    Mousavi, Mohammad Reza
    Tappler, Martin
    Taromirad, Masoumeh
    MACHINE LEARNING FOR DYNAMIC SOFTWARE ANALYSIS: POTENTIALS AND LIMITS, 2018, 11026 : 74 - 100
  • [5] Model-Based Edge Clustering
    Sewell, Daniel K.
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2021, 30 (02) : 390 - 405
  • [6] Model-based Differentially Private Data Synthesis and Statistical Infer- ence in Multiple Synthetic Datasets
    Liu, Fang
    TRANSACTIONS ON DATA PRIVACY, 2022, 15 (03) : 141 - 175
  • [7] Model-based analysis of latent factors
    Gregorius, Hans-Rolf
    WEB ECOLOGY, 2018, 18 (02) : 153 - 162
  • [8] Model-based clustering for populations of networks
    Signorelli, Mirko
    Wit, Ernst C.
    STATISTICAL MODELLING, 2020, 20 (01) : 9 - 29
  • [9] A methodology for probabilistic model-based prognosis
    Lorton, A.
    Fouladirad, M.
    Grall, A.
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2013, 225 (03) : 443 - 454
  • [10] Model-Based Treatment of Rapid Guessing
    Deribo, Tobias
    Kroehne, Ulf
    Goldhammer, Frank
    JOURNAL OF EDUCATIONAL MEASUREMENT, 2021, 58 (02) : 281 - 303