Grid based variational approximations

被引:6
作者
Ormerod, John T. [1 ]
机构
[1] Univ Sydney, Sch Math & Stat, Sydney, NSW 2006, Australia
基金
澳大利亚研究理事会;
关键词
Bayesian Inference; Variational approximation; Kullback-Liebler divergence; Markov chain Monte Carlo; INFERENCE;
D O I
10.1016/j.csda.2010.04.024
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Variational methods for approximate Bayesian inference provide fast, flexible, deterministic alternatives to Monte Carlo methods. Unfortunately, unlike Monte Carlo methods, variational approximations cannot, in general, be made to be arbitrarily accurate. This paper develops grid-based variational approximations which endeavor to approximate marginal posterior densities in a spirit similar to the Integrated Nested Laplace Approximation (INLA) of Rue etal. (2009) but which may be applied in situations where INLA cannot be used. The method can greatly increase the accuracy of a base variational approximation, although not in general to arbitrary accuracy. The methodology developed is at least reasonably accurate on all of the examples considered in the paper. (C) 2010 Elsevier B.V. All rights reserved.
引用
收藏
页码:45 / 56
页数:12
相关论文
共 31 条
  • [21] Explaining Variational Approximations
    Ormerod, J. T.
    Wand, M. P.
    [J]. AMERICAN STATISTICIAN, 2010, 64 (02) : 140 - 153
  • [22] ORMEROD JT, 2009, J ROYAL STAT SOC B, V71, P377
  • [23] ORMEROD JT, 2010, GAUSSIAN VARIA UNPUB
  • [24] Pournelle G. H., 1953, Journal of Mammalogy, V34, P133, DOI 10.1890/0012-9658(2002)083[1421:SDEOLC]2.0.CO
  • [25] 2
  • [26] RUBIN DB, 1976, BIOMETRIKA, V63, P581, DOI 10.1093/biomet/63.3.581
  • [27] Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations
    Rue, Havard
    Martino, Sara
    Chopin, Nicolas
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2009, 71 : 319 - 392
  • [28] Seeger M, 2000, ADV NEUR IN, V12, P603
  • [29] VENABLES WN, 2009, MASS FUNCTIONS DATAS
  • [30] Convergence properties of a general algorithm for calculating variational Bayesian estimates for a normal mixture model
    Wang, Bo
    Titterington, D. M.
    [J]. BAYESIAN ANALYSIS, 2006, 1 (03): : 625 - 649