Small-noise approximation for Bayesian optimal experimental design with nuisance uncertainty

被引:9
作者
Bartuska, Arved [1 ]
Espath, Luis [2 ]
Tempone, Raul [1 ,3 ,4 ]
机构
[1] Rhein Westfal TH Aachen, Dept Math, Gebaude-1953 1OG, Pontdriesch 14-16, D-52062 Aachen, Germany
[2] Univ Nottingham, Sch Math Sci, Nottingham NG7 2RD, England
[3] King Abdullah Univ Sci & Technol KAUST, Comp Elect & Math Sci & Engn Div CEMSE, Thuwal 239556900, Saudi Arabia
[4] Rhein Westfal TH Aachen, Mathe Uncertainty Quantification, Aachen, Germany
关键词
Bayesian experimental design; Nuisance uncertainty; Small-noise approximation; Monte Carlo; Laplace approximation; Importance sampling; EXPECTED INFORMATION GAINS;
D O I
10.1016/j.cma.2022.115320
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Calculating the expected information gain in optimal Bayesian experimental design typically relies on nested Monte Carlo sampling. When the model also contains nuisance parameters, which are parameters that contribute to the overall uncertainty of the system but are of no interest in the Bayesian design framework, this introduces a second inner loop. We propose and derive a small-noise approximation for this additional inner loop. The computational cost of our method can be further reduced by applying a Laplace approximation to the remaining inner loop. Thus, we present two methods, the small-noise double-loop Monte Carlo and small-noise Monte Carlo Laplace methods. Moreover, we demonstrate that the total complexity of these two approaches remains comparable to the case without nuisance uncertainty. To assess the efficiency of these methods, we present three examples, and the last example includes the partial differential equation for the electrical impedance tomography experiment for composite laminate materials.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:21
相关论文
共 30 条
  • [1] Alexanderian A, 2020, Arxiv, DOI arXiv:2006.11939
  • [2] Multilevel double loop Monte Carlo and stochastic collocation methods with importance sampling for Bayesian optimal experimental design
    Beck, Joakim
    Dia, Ben Mansour
    Espath, Luis
    Tempone, Raul
    [J]. INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN ENGINEERING, 2020, 121 (15) : 3482 - 3503
  • [3] Fast Bayesian experimental design: Laplace-based importance sampling for the expected information gain
    Beck, Joakim
    Dia, Ben Mansour
    Espath, Luis F. R.
    Long, Quan
    Tempone, Raul
    [J]. COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2018, 334 : 523 - 553
  • [4] BERNARDO JM, 1979, J R STAT SOC B, V41, P113
  • [5] Optimal Bayesian Experimental Design for Priors of Compact Support with Application to Shock-Tube Experiments for Combustion Kinetics
    Bisetti, Fabrizio
    Kim, Daesang
    Knio, Omar
    Long, Quan
    Tempone, Raul
    [J]. INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN ENGINEERING, 2016, 108 (02) : 136 - 155
  • [6] Nesterov-aided stochastic gradient methods using Laplace approximation for Bayesian design optimization
    Carlon, Andre Gustavo
    Dia, Ben Mansour
    Espath, Luis
    Lopez, Rafael Holdorf
    Tempone, Raul
    [J]. COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2020, 363
  • [7] Bayesian experimental design: A review
    Chaloner, K
    Verdinelli, I
    [J]. STATISTICAL SCIENCE, 1995, 10 (03) : 273 - 304
  • [8] Feng C, 2019, Arxiv, DOI arXiv:1903.11187
  • [9] Non-asymptotic error estimates for the Laplace approximation in Bayesian inverse problems
    Helin, Tapio
    Kretschmann, Remo
    [J]. NUMERISCHE MATHEMATIK, 2022, 150 (02) : 521 - 549
  • [10] Kass R.E., 1990, BAYESIAN LIKELIHOOD, P473