The fallacy of placing confidence in confidence intervals

被引:0
作者
Richard D. Morey
Rink Hoekstra
Jeffrey N. Rouder
Michael D. Lee
Eric-Jan Wagenmakers
机构
[1] Cardiff University,
[2] University of Groningen,undefined
[3] University of Missouri,undefined
[4] University of California-Irvine,undefined
[5] University of Amsterdam,undefined
来源
Psychonomic Bulletin & Review | 2016年 / 23卷
关键词
Bayesian inference and parameter estimation; Bayesian statistics; Statistical inference; Statistics;
D O I
暂无
中图分类号
学科分类号
摘要
Interval estimates – estimates of parameters that include an allowance for sampling uncertainty – have long been touted as a key component of statistical analyses. There are several kinds of interval estimates, but the most popular are confidence intervals (CIs): intervals that contain the true parameter value in some known proportion of repeated samples, on average. The width of confidence intervals is thought to index the precision of an estimate; CIs are thought to be a guide to which parameter values are plausible or reasonable; and the confidence coefficient of the interval (e.g., 95 %) is thought to index the plausibility that the true parameter is included in the interval. We show in a number of examples that CIs do not necessarily have any of these properties, and can lead to unjustified or arbitrary inferences. For this reason, we caution against relying upon confidence interval theory to justify interval estimates, and suggest that other theories of interval estimation should be used instead.
引用
收藏
页码:103 / 123
页数:20
相关论文
共 106 条
[41]  
Hoekstra R(2009)Bayesian t-tests for accepting and rejecting the null hypothesis Psychonomic Bulletin and Review 16 225-15:46
[42]  
Morey RD(2008)Sketches for size of join estimation ACM Transactions on Database Systems 33 15:1-52
[43]  
Rouder JN(2011)Revisiting the Welch uniform model: A case for conditional inference? Advances and Applications in Statistical Science 5 33-182
[44]  
Wagenmakers E-J(2004)Beyond the F test: Effect size confidence intervals and tests of close fit in the analysis of variance and contrast analysis Psychological Methods 9 164-1096
[45]  
Hollingdale J(2000)GMM with weak identification Econometrica 68 1055-368
[46]  
Greitemeyer T(2014)Mechanisms of renewal after the extinction of discriminated operant behavior Journal of Experimental Psychology 40 355-608
[47]  
Kelley K(2008)Theory testing using quantitative predictions of effect size Applied Psychology 57 589-466
[48]  
Kruschke JK(2008)Comment on article by Gelman Bayesian Analysis 3 463-69
[49]  
Lahiri DK(1939)On confidence limits and sufficiency, with particular reference to parameters of location The Annals of Mathematical Statistics 10 58-111
[50]  
Maloney B(2012)A default Bayesian hypothesis test for ANOVA designs American Statistician 66 104-604