Fast Bayesian experimental design: Laplace-based importance sampling for the expected information gain

被引:59
作者
Beck, Joakim [1 ]
Dia, Ben Mansour [2 ]
Espath, Luis F. R. [1 ]
Long, Quan [3 ]
Tempone, Raul [1 ]
机构
[1] King Abdullah Univ Sci & Technol, Comp Elect & Math Sci & Engn Div CEMSE, Thuwal 239556900, Saudi Arabia
[2] King Fahd Univ Petr & Minerals, Coll Petr Engn & Geosci, CIPR, Dhahran 31261, Saudi Arabia
[3] United Technol Res Ctr, E Hartford, CT 06108 USA
关键词
Bayesian experimental design; Expected information gain; Monte Carlo; Laplace approximation; Importance sampling; Composite materials; APPROXIMATIONS;
D O I
10.1016/j.cma.2018.01.053
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In calculating expected information gain in optimal Bayesian experimental design, the computation of the inner loop in the classical double-loop Monte Carlo requires a large number of samples and suffers from underflow if the number of samples is small. These drawbacks can be avoided by using an importance sampling approach. We present a computationally efficient method for optimal Bayesian experimental design that introduces importance sampling based on the Laplace method to the inner loop. We derive the optimal values for the method parameters in which the average computational cost is minimized for a specified error tolerance. We use three numerical examples to demonstrate the computational efficiency of our method compared with the classical double-loop Monte Carlo, and a single-loop Monte Carlo method that uses the Laplace approximation of the return value of the inner loop. The first demonstration example is a scalar problem that is linear in the uncertain parameter. The second example is a nonlinear scalar problem. The third example deals with the optimal sensor placement for an electrical impedance tomography experiment to recover the fiber orientation in laminate composites. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:523 / 553
页数:31
相关论文
共 22 条
[1]   A FAST AND SCALABLE METHOD FOR A-OPTIMAL DESIGN OF EXPERIMENTS FOR INFINITE-DIMENSIONAL BAYESIAN NONLINEAR INVERSE PROBLEMS [J].
Alexanderian, Alen ;
Petra, Noemi ;
Stadler, Georg ;
Ghattas, Omar .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2016, 38 (01) :A243-A272
[2]  
[Anonymous], 1990, Bayesian and likelihood methods in statistics and econometrics
[3]   Sequential Design with Mutual Information for Computer Experiments (MICE): Emulation of a Tsunami Model [J].
Beck, Joakim ;
Guillas, Serge .
SIAM-ASA JOURNAL ON UNCERTAINTY QUANTIFICATION, 2016, 4 (01) :739-766
[4]   Optimal Bayesian Experimental Design for Priors of Compact Support with Application to Shock-Tube Experiments for Combustion Kinetics [J].
Bisetti, Fabrizio ;
Kim, Daesang ;
Knio, Omar ;
Long, Quan ;
Tempone, Raul .
INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN ENGINEERING, 2016, 108 (02) :136-155
[5]  
COLLIER N, 2014, BIT, V55, P1
[6]  
Feng C., 2015, Camera Marker Networks for Pose Estimation and Scene Understanding in Construction Automation and Robotics
[7]   Multilevel Monte Carlo path simulation [J].
Giles, Michael B. .
OPERATIONS RESEARCH, 2008, 56 (03) :607-617
[8]   On the Measure of the Information in a Statistical Experiment [J].
Ginebra, Josep .
BAYESIAN ANALYSIS, 2007, 2 (01) :167-211
[9]   Simulation-based optimal Bayesian experimental design for nonlinear systems [J].
Huan, Xun ;
Marzouk, Youssef M. .
JOURNAL OF COMPUTATIONAL PHYSICS, 2013, 232 (01) :288-317
[10]   ON INFORMATION AND SUFFICIENCY [J].
KULLBACK, S ;
LEIBLER, RA .
ANNALS OF MATHEMATICAL STATISTICS, 1951, 22 (01) :79-86