Particle Learning for General Mixtures

被引:34
作者
Carvalho, Carlos M. [1 ]
Lopes, Hedibert F. [2 ]
Polson, Nicholas G. [2 ]
Taddy, Matt A. [2 ]
机构
[1] Univ Texas Austin, McCombs Sch Business, Austin, TX 78712 USA
[2] Booth Sch Business, Chicago, IL USA
来源
BAYESIAN ANALYSIS | 2010年 / 5卷 / 04期
关键词
Nonparametric; mixture models; particle filtering; Dirichlet process; Indian buffet process; probit stick-breaking; MARGINAL LIKELIHOOD; BAYESIAN-ANALYSIS; SAMPLING METHODS; UNKNOWN NUMBER; INFERENCE; MODELS; DISTRIBUTIONS;
D O I
10.1214/10-BA525
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
This paper develops particle learning (PL) methods for the estimation of general mixture models. The approach is distinguished from alternative particle filtering methods in two major ways. First, each iteration begins by resampling particles according to posterior predictive probability, leading to a more efficient set for propagation. Second, each particle tracks only the "essential state vector" thus leading to reduced dimensional inference. In addition, we describe how the approach will apply to more general mixture models of current interest in the literature; it is hoped that this will inspire a greater number of researchers to adopt sequential Monte Carlo methods for fitting their sophisticated mixture based models. Finally, we show that PL leads to straight forward tools for marginal likelihood calculation and posterior cluster allocation.
引用
收藏
页码:709 / 740
页数:32
相关论文
共 54 条
[41]   SIZE-BIASED SAMPLING OF POISSON POINT-PROCESSES AND EXCURSIONS [J].
PERMAN, M ;
PITMAN, J ;
YOR, M .
PROBABILITY THEORY AND RELATED FIELDS, 1992, 92 (01) :21-39
[42]   EXCHANGEABLE AND PARTIALLY EXCHANGEABLE RANDOM PARTITIONS [J].
PITMAN, J .
PROBABILITY THEORY AND RELATED FIELDS, 1995, 102 (02) :145-158
[43]  
PITT M, 1999, SIMULATION, V94, P590
[44]   Computational aspects of nonparametric Bayesian analysis with applications to the modeling of multiple binary sequences [J].
Quintana, FA ;
Newton, MA .
JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2000, 9 (04) :711-737
[45]  
REGAZZINI E, 1998, BAYESIAN STAT, V6
[46]   On Bayesian analysis of mixtures with an unknown number of components [J].
Richardson, S ;
Green, PJ .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1997, 59 (04) :731-758
[47]  
RODRIGUEZ A, 2009, UCSCSOE0912
[48]   The Nested Dirichlet Process [J].
Rodriguez, Abel ;
Dunson, David B. ;
Gelfand, Alan E. .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2008, 103 (483) :1131-1144
[49]   Dealing with label switching in mixture models [J].
Stephens, M .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2000, 62 :795-809
[50]  
TADDY MA, 2010, J AM STAT A IN PRESS