Efficient Acquisition Rules for Model-Based Approximate Bayesian Computation

被引:33
作者
Jarvenpaa, Marko [1 ]
Gutmann, Michael U. [2 ]
Pleska, Arijus [1 ]
Vehtari, Aki [1 ]
Marttinen, Pekka [1 ]
机构
[1] Aalto Univ, Dept Comp Sci, Helsinki Inst Informat Technol HIIT, Helsinki, Finland
[2] Univ Edinburgh, Sch Informat, Edinburgh, Midlothian, Scotland
来源
BAYESIAN ANALYSIS | 2019年 / 14卷 / 02期
基金
芬兰科学院;
关键词
approximate Bayesian computation; intractable likelihood; Gaussian processes; Bayesian optimisation; sequential experiment design; MONTE-CARLO; STATISTICAL-INFERENCE; REDUCTION;
D O I
10.1214/18-BA1121
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Approximate Bayesian computation (ABC) is a method for Bayesian inference when the likelihood is unavailable but simulating from the model is possible. However, many ABC algorithms require a large number of simulations, which can be costly. To reduce the computational cost, Bayesian optimisation (BO) and surrogate models such as Gaussian processes have been proposed. Bayesian optimisation enables one to intelligently decide where to evaluate the model next but common BO strategies are not designed for the goal of estimating the posterior distribution. Our paper addresses this gap in the literature. We propose to compute the uncertainty in the ABC posterior density, which is due to a lack of simulations to estimate this quantity accurately, and define a loss function that measures this uncertainty. We then propose to select the next evaluation location to minimise the expected loss. Experiments show that the proposed method often produces the most accurate approximations as compared to common BO strategies.
引用
收藏
页码:595 / 622
页数:28
相关论文
共 56 条
  • [1] [Anonymous], INT C ART INT STAT
  • [2] [Anonymous], 2012, P ADV NEUR INF PROC
  • [3] [Anonymous], 2006, Gaussian processes in machine learning
  • [4] [Anonymous], 2014, COMP EMULATION METHO
  • [5] Beaumont MA, 2002, GENETICS, V162, P2025
  • [6] Adaptive approximate Bayesian computation
    Beaumont, Mark A.
    Cornuet, Jean-Marie
    Marin, Jean-Michel
    Robert, Christian P.
    [J]. BIOMETRIKA, 2009, 96 (04) : 983 - 990
  • [7] Bijl H., 2016, SEQUENTIAL MONTE CAR
  • [8] A Comparative Review of Dimension Reduction Methods in Approximate Bayesian Computation
    Blum, M. G. B.
    Nunes, M. A.
    Prangle, D.
    Sisson, S. A.
    [J]. STATISTICAL SCIENCE, 2013, 28 (02) : 189 - 208
  • [9] Approximate Bayesian Computation: A Nonparametric Perspective
    Blum, Michael G. B.
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2010, 105 (491) : 1178 - 1187
  • [10] Non-linear regression models for Approximate Bayesian Computation
    Blum, Michael G. B.
    Francois, Olivier
    [J]. STATISTICS AND COMPUTING, 2010, 20 (01) : 63 - 73