A Bayesian Approach to Sequential Optimization based on Computer Experiments

被引:7
作者
Tajbakhsh, Sam Davanloo [1 ]
del Castillo, Enrique [1 ]
Rosenberger, James L. [2 ]
机构
[1] Penn State Univ, Dept Ind & Mfg Engn, University Pk, PA 16802 USA
[2] Penn State Univ, Dept Stat, University Pk, PA 16802 USA
关键词
Gaussian processes; bootstrapping; expected improvement; EFFICIENT GLOBAL OPTIMIZATION; DESIGN;
D O I
10.1002/qre.1658
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Computer experiments are used frequently for the study and improvement of a process under study. Optimizing such process based on a computer model is costly, so an approximation of the computer model, or metamodel, is used. Efficient global optimization (EGO) is a sequential optimization method for computer experiments based on a Gaussian process model approximation to the computer model response. A long-standing problem in EGO is that it does not consider the uncertainty in the parameter estimates of the Gaussian process. Treating these estimates as if they are the true parameters leads to an improper assessment of the precision of the approximation, a precision that is crucial to assess not only in optimization but in metamodeling in general. One way to account for these uncertainties is to use bootstrapping, studied by previous authors. Alternatively, some other authors have mentioned how a Bayesian approach may be the best way to incorporate the parameter uncertainty in the optimization, but no fully Bayesian approach for EGO has been implemented in practice. In this paper, we present a fully Bayesian implementation of the EGO method. The proposed Bayesian EGO algorithm is validated through simulation of noisy nonlinear functions and compared with the standard EGO method and the bootstrapped EGO. We also apply the Bayesian EGO algorithm to the optimization of a stochastic computer model. It is shown how a Bayesian approach to EGO allows one to optimize any function of the posterior predictive density. Copyright (C) 2014 John Wiley & Sons, Ltd.
引用
收藏
页码:1001 / 1012
页数:12
相关论文
共 36 条
  • [1] Anderson T.W., 2003, INTRO MULTIVARIATE S
  • [2] [Anonymous], DESIGNING ANAL COMPU
  • [3] [Anonymous], GLOBAL OPTIMISATION
  • [4] [Anonymous], 2003, QUAL ENG
  • [5] [Anonymous], 2001, Sequential Monte Carlo methods in practice
  • [6] [Anonymous], 2010, INTRO MONTE CARLO ME
  • [7] [Anonymous], GAUSSIAN PROCESS BAS
  • [8] [Anonymous], 1975, CYBERNETICS
  • [9] [Anonymous], J OPER RES SOC
  • [10] [Anonymous], KRIGIFIER PROCEDURE