Particle Learning for General Mixtures

被引:34
作者
Carvalho, Carlos M. [1 ]
Lopes, Hedibert F. [2 ]
Polson, Nicholas G. [2 ]
Taddy, Matt A. [2 ]
机构
[1] Univ Texas Austin, McCombs Sch Business, Austin, TX 78712 USA
[2] Booth Sch Business, Chicago, IL USA
来源
BAYESIAN ANALYSIS | 2010年 / 5卷 / 04期
关键词
Nonparametric; mixture models; particle filtering; Dirichlet process; Indian buffet process; probit stick-breaking; MARGINAL LIKELIHOOD; BAYESIAN-ANALYSIS; SAMPLING METHODS; UNKNOWN NUMBER; INFERENCE; MODELS; DISTRIBUTIONS;
D O I
10.1214/10-BA525
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
This paper develops particle learning (PL) methods for the estimation of general mixture models. The approach is distinguished from alternative particle filtering methods in two major ways. First, each iteration begins by resampling particles according to posterior predictive probability, leading to a more efficient set for propagation. Second, each particle tracks only the "essential state vector" thus leading to reduced dimensional inference. In addition, we describe how the approach will apply to more general mixture models of current interest in the literature; it is hoped that this will inspire a greater number of researchers to adopt sequential Monte Carlo methods for fitting their sophisticated mixture based models. Finally, we show that PL leads to straight forward tools for marginal likelihood calculation and posterior cluster allocation.
引用
收藏
页码:709 / 740
页数:32
相关论文
共 54 条
[1]  
[Anonymous], ADV NEURAL INFORM PR
[2]   MIXTURES OF DIRICHLET PROCESSES WITH APPLICATIONS TO BAYESIAN NONPARAMETRIC PROBLEMS [J].
ANTONIAK, CE .
ANNALS OF STATISTICS, 1974, 2 (06) :1152-1174
[3]   Marginal likelihood and Bayes factors for Dirichlet process mixture models [J].
Basu, S ;
Chib, S .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2003, 98 (461) :224-235
[4]   FERGUSON DISTRIBUTIONS VIA POLYA URN SCHEMES [J].
BLACKWELL, D ;
MACQUEEN, JB .
ANNALS OF STATISTICS, 1973, 1 (02) :353-355
[5]   Variational Inference for Dirichlet Process Mixtures [J].
Blei, David M. ;
Jordan, Michael I. .
BAYESIAN ANALYSIS, 2006, 1 (01) :121-143
[6]   A semiparametric Bayesian model for randomised block designs [J].
Bush, CA ;
MacEachern, SN .
BIOMETRIKA, 1996, 83 (02) :275-285
[7]   Particle Learning and Smoothing [J].
Carvalho, Carlos M. ;
Johannes, Michael S. ;
Lopes, Hedibert F. ;
Polson, Nicholas G. .
STATISTICAL SCIENCE, 2010, 25 (01) :88-106
[8]   Marginal likelihood from the Gibbs output [J].
Chib, S .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1995, 90 (432) :1313-1321
[9]   Marginal likelihood from the Metropolis-Hastings output [J].
Chib, S ;
Jeliazkov, I .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (453) :270-281
[10]   A sequential particle filter method for static models [J].
Chopin, N .
BIOMETRIKA, 2002, 89 (03) :539-551