An Exploitation-Enhanced Bayesian Optimization Algorithm for High-Dimensional Expensive Problems

被引:0
作者
Gui, Yuqian [1 ]
Zhan, Dawei [1 ]
Li, Tianrui [1 ]
机构
[1] Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China
来源
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT III | 2023年 / 14256卷
关键词
Expensive optimization; Bayesian optimization; Expected improvement; Local model; EFFICIENT GLOBAL OPTIMIZATION;
D O I
10.1007/978-3-031-44213-1_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Bayesian optimization (BO) algorithm is widely used to solve expensive optimization problems. However, when dealing with high-dimensional problems, the accuracy of the global Gaussian process (GP) model is often inadequate due to the limited number of training points. As a result, the search based on the expected improvement criterion can lead to misguided exploration. To address this issue, we propose an exploitation-enhanced Bayesian optimization (EE-BO) algorithm. Our approach incorporates a local GP model built around the evaluated solution from the previous iteration, which is used to find the next infill solution if the current selection from the global GP model is not an improvement. The inclusion of the local model mitigates the impact of inaccurate models and enhances the algorithm's ability to perform local searches when the global model struggles to find better solutions. Our numerical experiments show that the proposed EE-BO algorithm outperforms the vanilla BO algorithm and achieves competitive performance compared to five state-of-the-art algorithms.
引用
收藏
页码:295 / 306
页数:12
相关论文
共 50 条
[41]   High-dimensional automated radiation therapy treatment planning via Bayesian optimization [J].
Wang, Qingying ;
Wang, Ruoxi ;
Liu, Jiacheng ;
Jiang, Fan ;
Yue, Haizhen ;
Du, Yi ;
Wu, Hao .
MEDICAL PHYSICS, 2023, 50 (06) :3773-3787
[42]   BAYESIAN OPTIMIZATION FOR MULTI-OBJECTIVE HIGH-DIMENSIONAL TURBINE AERO DESIGN [J].
Zhang, Yiming ;
Ghosh, Sayan ;
Vandeputte, Thomas ;
Wang, Liping .
PROCEEDINGS OF ASME TURBO EXPO 2021: TURBOMACHINERY TECHNICAL CONFERENCE AND EXPOSITION, VOL 9B, 2021,
[43]   Re-examining Supervised Dimension Reduction for High-Dimensional Bayesian Optimization [J].
Chen, Quanlin ;
Huo, Jing ;
Chen, Yiyu ;
Ding, Tianyu ;
Gao, Yang ;
Li, Dong ;
He, Xu .
PARALLEL PROBLEM SOLVING FROM NATURE-PPSN XVIII, PT II, PPSN 2024, 2024, 15149 :356-373
[44]   On the development of a practical Bayesian optimization algorithm for expensive experiments and simulations with changing environmental conditions [J].
Diessner, Mike ;
Wilson, Kevin J. ;
Whalley, Richard D. .
DATA-CENTRIC ENGINEERING, 2024, 5
[45]   Combination of optimization-free kriging models for high-dimensional problems [J].
Appriou, Tanguy ;
Rulliere, Didier ;
Gaudrie, David .
COMPUTATIONAL STATISTICS, 2024, 39 (06) :3049-3071
[46]   A Sampling Strategy for High-Dimensional, Simulation-Based Transportation Optimization Problems [J].
Tay, Timothy ;
Osorio, Carolina .
TRANSPORTATION SCIENCE, 2024, 58 (05) :947-972
[47]   An adaptive batch Bayesian optimization approach for expensive multi-objective problems [J].
Wang, Hongyan ;
Xu, Hua ;
Yuan, Yuan ;
Zhang, Zeqiu .
INFORMATION SCIENCES, 2022, 611 :446-463
[48]   Bayesian Co-evolutionary Optimization based entropy search for high-dimensional many-objective optimization [J].
Bian, Hongli ;
Tian, Jie ;
Yu, Jialiang ;
Yu, Han .
KNOWLEDGE-BASED SYSTEMS, 2023, 274
[49]   High-Dimensional Bayesian Optimization of Personalized Cardiac Model Parameters via an Embedded Generative Model [J].
Dhamala, Jwala ;
Ghimire, Sandesh ;
Sapp, John L. ;
Horacek, B. Milan ;
Wang, Linwei .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT II, 2018, 11071 :499-507
[50]   Solving High-Dimensional Multi-Objective Optimization Problems with Low Effective Dimensions [J].
Qian, Hong ;
Yu, Yang .
THIRTY-FIRST AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, :875-881