A large-deviation principle for Dirichlet posteriors

被引:15
作者
Ganesh, AJ
O'Connell, N
机构
[1] Microsoft Res, Cambridge CB2 3NH, England
[2] Hewlett Packard Labs, BRIMS, Bristol BS12 6QZ, Avon, England
关键词
asymptotics; Bayesian nonparametrics; Dirichlet process; large deviations;
D O I
10.2307/3318469
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Let X-k be a sequence of independent and identically distributed random variables taking values in a compact metric space Omega, and consider the problem of estimating the law of X-1 in a Bayesian framework. A conjugate family of priors for nonparametric Bayesian inference is the Dirichlet process priors popularized by Ferguson. We prove that if the prior distribution is Dirichlet, then the sequence of posterior distributions satisfies a large-deviation principle, and give an explicit expression for the rate function. As an application, we obtain an asymptotic formula for the predictive probability of ruin in the classical gambler's ruin problem.
引用
收藏
页码:1021 / 1034
页数:14
相关论文
共 18 条
[1]  
Barron A, 1999, ANN STAT, V27, P536
[2]  
Dembo A., 1993, Large deviations techniques and applications
[3]  
DUPUIS P., 2011, A Weak Convergence Approach to the Theory of Large Deviations
[4]   BAYESIAN ANALYSIS OF SOME NONPARAMETRIC PROBLEMS [J].
FERGUSON, TS .
ANNALS OF STATISTICS, 1973, 1 (02) :209-230
[5]   PRIOR DISTRIBUTIONS ON SPACES OF PROBABILITY MEASURES [J].
FERGUSON, TS .
ANNALS OF STATISTICS, 1974, 2 (04) :615-629
[6]   ON ASYMPTOTIC-BEHAVIOR OF BAYES ESTIMATES IN DISCRETE CASE [J].
FREEDMAN, DA .
ANNALS OF MATHEMATICAL STATISTICS, 1963, 34 (04) :1386-&
[7]   Bayesian network management [J].
Ganesh, A ;
Green, P ;
O'Connell, N ;
Pitts, S .
QUEUEING SYSTEMS, 1998, 28 (1-3) :267-282
[8]   An inverse of Sanov's theorem [J].
Ganesh, A ;
O'Connell, N .
STATISTICS & PROBABILITY LETTERS, 1999, 42 (02) :201-206
[9]  
Georgii H.-O., 1988, Gibbs Measures and Phase Transitions
[10]  
GHOSAL S, 1998, CONVERGENCE RATES PO