Nonparametric Predictive Inference for Test Reproducibility by Sampling Future Data Orderings

被引：0
作者：
Frank P. A. Coolen
Filipe J. Marques
机构：
[1] Durham University,
[2] Universidade Nova de Lisboa,undefined
来源：
Journal of Statistical Theory and Practice | 2020年 / 14卷
关键词：
Exponential family; Likelihood ratio test; Lower and upper probabilities; Nonparametric predictive inference; Normal distribution; Reproducibility probability; Sampling orderings of future observations; 62A99; 62G99; 62P30;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
This paper considers nonparametric predictive inference (NPI) for reproducibility of likelihood ratio tests with the test criterion in terms of the sample mean. Given a sample of size n used for the actual test, the NPI approach provides lower and upper probabilities for the event that a repeat of the test, also with n observations, will lead to the same overall test conclusion, that is rejecting a null-hypothesis or not. This is achieved by considering all orderings of n future observations among the n data observations, which based on an exchangeability assumption are equally likely. However, exact lower and upper probabilities can only be derived for relatively small values of n due to computational limitations. Therefore, the main aim of this paper is to explore sampling of the orderings of the future data among the observed data in order to approximate the lower and upper reproducibility probabilities. The approach is applied for the Exponential and Normal distributions, and the performance of the ordering sampling for approximation of the NPI lower and upper reproducibility probabilities is investigated. An application with real data of the methodology developed is provided.
引用
收藏
相关论文
共 34 条
  • [1] Arts GRJ(2004)Nonparametric predictive inference in statistical process control Qual Technol Quant Manag 1 201-216
  • [2] Coolen FPA(2004)Nonparametric predictive inference and interval probability J Stat Plan Inference 124 251-272
  • [3] van der Laan P(2001)Interval estimation for a binomial proportion Stat Sci 16 101-133
  • [4] Augustin T(2006)On nonparametric predictive inference and objective Bayesianism J Logic Lang Inf 15 21-47
  • [5] Coolen FPA(2014)Nonparametric predictive inference for reproducibility of basic nonparametric tests J Stat Theory Pract 8 591-618
  • [6] Brown LD(2020)Nonparametric predictive inference bootstrap with application to reproducibility of the two-sample Kolmogorov–Smirnov test J Stat Theory Pract 14 26-946
  • [7] Cai TT(2011)On stochastic orderings of the Wilcoxon rank sum test statistic - with applications to reproducibility probability estimation testing Stat Probab Lett 81 937-1061
  • [8] DasGupta A(2008)Reproducibility probability estimation for testing statistical hypotheses Stat Probab Lett 78 1056-879
  • [9] Coolen FPA(1992)A comment on replication, p-values and evidence Stat Med 11 875-691
  • [10] Coolen FPA(1968)Posterior distribution of percentiles: Bayes’ theorem for sampling from a population J Am Stat Assoc 63 677-229
1234