Joint Model Selection and Parameter Estimation by Population Monte Carlo Simulation

被引:18
作者
Hong, Mingyi [1 ]
Bugallo, Monica F. [2 ]
Djuric, Petar M. [2 ]
机构
[1] Univ Virginia, Dept Syst & Informat Engn, Charlottesville, VA 22903 USA
[2] SUNY Stony Brook, Dept Elect & Comp Engn, Stony Brook, NY 11794 USA
基金
美国国家科学基金会;
关键词
Bayesian methods; Markov Chain Monte Carlo (MCMC); model selection; Population Monte Carlo (PMC); POSTERIOR DISTRIBUTIONS; SINUSOIDS; MCMC;
D O I
10.1109/JSTSP.2010.2048385
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we study the problem of joint model selection and parameter estimation under the Bayesian framework. We propose to use the Population Monte Carlo (PMC) methodology in carrying out Bayesian computations. The PMC methodology has recently been proposed as an efficient sampling technique and an alternative to Markov Chain Monte Carlo (MCMC) sampling. Its flexibility in constructing transition kernels allows for joint sampling of parameter spaces that belong to different models. The proposed method is able to estimate the desired a posteriori distributions accurately. In comparison to the Reversible Jump MCMC (RJMCMC) algorithm, which is popular in solving the same problem, the PMC algorithm does not require burn-in period, it produces approximately uncorrelated samples, and it can be implemented in a parallel fashion. We demonstrate our approach on two examples: sinusoids in white Gaussian noise and direction of arrival (DOA) estimation in colored Gaussian noise, where in both cases the number of signals in the data is a priori unknown. Both simulations show the effectiveness of our proposed algorithm.
引用
收藏
页码:526 / 539
页数:14
相关论文
共 28 条
[1]   Model selection by MCMC computation [J].
Andrieu, C ;
Djuric, PM ;
Doucet, A .
SIGNAL PROCESSING, 2001, 81 (01) :19-37
[2]   Joint Bayesian model selection and estimation of noisy sinusoids via reversible jump MCMC [J].
Andrieu, C ;
Doucet, A .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1999, 47 (10) :2667-2676
[3]  
[Anonymous], 2001, Sequential Monte Carlo methods in practice
[4]  
[Anonymous], 2005, Monte Carlo statistical methods
[5]  
[Anonymous], ESAIM PROBAB STAT
[6]  
Box G.E., 2011, Bayesian inference in statistical analysis
[7]  
BUGALLO MF, 2009, P IEEE INT C AC SPEE
[8]   Population Monte Carlo [J].
Cappé, O ;
Guillin, A ;
Marin, JM ;
Robert, CP .
JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2004, 13 (04) :907-929
[9]   Iterated importance sampling in missing data problems [J].
Celeux, Gilles ;
Marin, Jean-Michel ;
Robert, Christian P. .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2006, 50 (12) :3386-3404
[10]   Bayesian detection and estimation of cisoids in colored noise [J].
Cho, CM ;
Djuric, PM .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1995, 43 (12) :2943-2952