Kullback Leibler property of kernel mixture priors in Bayesian density estimation

被引:57
作者
Wu, Yuefeng [1 ]
Ghosal, Subhashis [1 ]
机构
[1] N Carolina State Univ, Dept Stat, Raleigh, NC 27695 USA
关键词
Bayesian density estimation; Dirichlet process; kernel mixture; Kullback-Leibler property; posterior consistency;
D O I
10.1214/07-EJS130
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Positivity of the prior probability of Kullback-Leibler neighborhood around the true density, commonly known as the Kullback-Leibler property, plays a fundamental role in posterior consistency. A popular prior for Bayesian estimation is given by a Dirichlet mixture, where the kernels are chosen depending on the sample space and the class of densities to be estimated. The Kullback-Leibler property of the Dirichlet mixture prior has been shown for some special kernels like the normal density or Bernstein polynomial, under appropriate conditions. In this paper, we obtain easily verifiable sufficient conditions, under which a prior obtained by mixing a general kernel possesses the Kullback-Leibler property. We study a wide variety of kernel used in practice, including the normal, t, histogram, gamma, Weibull densities and so on, and show that the Kullback-Leibler property holds if some easily verifiable conditions are satisfied at the true density. This gives a catalog of conditions required for the Kullback-Leibler property, which can be readily used in applications.
引用
收藏
页码:298 / 331
页数:34
相关论文
共 32 条
[1]  
[Anonymous], 1988, Real analysis
[2]  
[Anonymous], 1983, RECNT ADV STAT
[3]   MIXTURES OF DIRICHLET PROCESSES WITH APPLICATIONS TO BAYESIAN NONPARAMETRIC PROBLEMS [J].
ANTONIAK, CE .
ANNALS OF STATISTICS, 1974, 2 (06) :1152-1174
[4]  
ARFKEN G., 1985, DIAGMMA POLYGAMMA FU
[5]  
BOUEZMARNI T., 2003, CONSISTENCY ASYMMETR
[6]   Probability density function estimation using gamma kernels [J].
Chen, SX .
ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2000, 52 (03) :471-480
[7]  
CHOsAL S., 2009, THEORY NONP IN PRESS
[8]  
Diaconis P., 1985, BAYESIAN STATISTICS, V2, P133
[9]   BAYESIAN DENSITY-ESTIMATION AND INFERENCE USING MIXTURES [J].
ESCOBAR, MD ;
WEST, M .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1995, 90 (430) :577-588
[10]  
Escobar MD, 1998, PRACTICAL NONPARAMET, V133, P1