Mode jumping MCMC for Bayesian variable selection in GLMM

被引:13
作者
Hubin, Aliaksandr [1 ,2 ]
Storvik, Geir [1 ]
机构
[1] Univ Oslo, Dept Math, Oslo, Norway
[2] Univ Oslo, Moltke Moes Vei 35, N-0851 Oslo, Norway
关键词
Bayesian variable selection; Bayesian model averaging; Generalized linear mixed models; Auxiliary variables MCMC; Combinatorial optimization; High performance computations; MARGINAL LIKELIHOOD; INFERENCE; APPROXIMATIONS; ALGORITHM; SAMPLER;
D O I
10.1016/j.csda.2018.05.020
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Generalized linear mixed models (GLMM) are used for inference and prediction in a wide range of different applications providing a powerful scientific tool. An increasing number of sources of data are becoming available, introducing a variety of candidate explanatory variables for these models. Selection of an optimal combination of variables is thus becoming crucial. In a Bayesian setting, the posterior distribution of the models, based on the observed data, can be viewed as a relevant measure for the model evidence. The number of possible models increases exponentially in the number of candidate variables. Moreover, the space of models has numerous local extrema in terms of posterior model probabilities. To resolve these issues a novel MCMC algorithm for the search through the model space via efficient mode jumping for GLMMs is introduced. The algorithm is based on that marginal likelihoods can be efficiently calculated within each model. It is recommended that either exact expressions or precise approximations of marginal likelihoods are applied. The suggested algorithm is applied to simulated data, the famous U.S. crime data, protein activity data and epigenetic data and is compared to several existing approaches. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:281 / 297
页数:17
相关论文
共 62 条
  • [1] Improving the acceptance rate of reversible jump MCMC proposals
    Al-Awadhi, F
    Hurn, M
    Jennison, C
    [J]. STATISTICS & PROBABILITY LETTERS, 2004, 69 (02) : 189 - 198
  • [2] Particle Markov chain Monte Carlo methods
    Andrieu, Christophe
    Doucet, Arnaud
    Holenstein, Roman
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2010, 72 : 269 - 342
  • [3] THE PSEUDO-MARGINAL APPROACH FOR EFFICIENT MONTE CARLO COMPUTATIONS
    Andrieu, Christophe
    Roberts, Gareth O.
    [J]. ANNALS OF STATISTICS, 2009, 37 (02) : 697 - 725
  • [4] [Anonymous], 1996, Gilks et al
  • [5] [Anonymous], REV COMPUT STAT
  • [6] [Anonymous], 2009, Advances in neural information processing systems
  • [7] [Anonymous], 2011, HDB MARKOV CHAIN MON
  • [8] [Anonymous], 2005, Monte_Carlo_Statistical_Methods_(Springer Texts_in_Statistics)
  • [9] Banterle M., 2015, ARXIV150300996
  • [10] Optimal predictive model selection
    Barbieri, MM
    Berger, JO
    [J]. ANNALS OF STATISTICS, 2004, 32 (03) : 870 - 897