An Exploitation-Enhanced Bayesian Optimization Algorithm for High-Dimensional Expensive Problems

被引:0
作者
Gui, Yuqian [1 ]
Zhan, Dawei [1 ]
Li, Tianrui [1 ]
机构
[1] Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China
来源
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT III | 2023年 / 14256卷
关键词
Expensive optimization; Bayesian optimization; Expected improvement; Local model; EFFICIENT GLOBAL OPTIMIZATION;
D O I
10.1007/978-3-031-44213-1_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Bayesian optimization (BO) algorithm is widely used to solve expensive optimization problems. However, when dealing with high-dimensional problems, the accuracy of the global Gaussian process (GP) model is often inadequate due to the limited number of training points. As a result, the search based on the expected improvement criterion can lead to misguided exploration. To address this issue, we propose an exploitation-enhanced Bayesian optimization (EE-BO) algorithm. Our approach incorporates a local GP model built around the evaluated solution from the previous iteration, which is used to find the next infill solution if the current selection from the global GP model is not an improvement. The inclusion of the local model mitigates the impact of inaccurate models and enhances the algorithm's ability to perform local searches when the global model struggles to find better solutions. Our numerical experiments show that the proposed EE-BO algorithm outperforms the vanilla BO algorithm and achieves competitive performance compared to five state-of-the-art algorithms.
引用
收藏
页码:295 / 306
页数:12
相关论文
共 50 条
  • [21] Surrogate-assisted grey wolf optimization for high-dimensional, computationally expensive black-box problems
    Dong, Huachao
    Dong, Zuomin
    SWARM AND EVOLUTIONARY COMPUTATION, 2020, 57 (57)
  • [22] A two-stage surrogate-assisted meta-heuristic algorithm for high-dimensional expensive problems
    Zheng, Liang
    Shi, Jinyue
    Yang, Youpeng
    SOFT COMPUTING, 2023, 27 (10) : 6465 - 6486
  • [23] A Neighborhood Regression Optimization Algorithm for Computationally Expensive Optimization Problems
    Zhou, Yuren
    He, Xiaoyu
    Chen, Zefeng
    Jiang, Siyu
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (05) : 3018 - 3031
  • [24] Constrained Evolutionary Bayesian Optimization for Expensive Constrained Optimization Problems With Inequality Constraints
    Liu, Jiao
    Wang, Yong
    Sun, Guangyong
    Pang, Tong
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2025, 55 (03): : 2009 - 2021
  • [25] High-dimensional expensive multi-objective optimization via additive structure
    Wang, Hongyan
    Xu, Hua
    Yuan, Yuan
    INTELLIGENT SYSTEMS WITH APPLICATIONS, 2022, 14
  • [26] Gradient-enhanced kriging for high-dimensional problems
    Bouhlel, Mohamed A.
    Martins, Joaquim R. R. A.
    ENGINEERING WITH COMPUTERS, 2019, 35 (01) : 157 - 173
  • [27] Active and Compact Entropy Search for High-Dimensional Bayesian Optimization
    Li, Run
    Shi, Yucheng
    Han, Yahong
    Shao, Yunfeng
    Qi, Meiyu
    Li, Bingshuai
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (01) : 59 - 70
  • [28] Optimization of high-dimensional expensive multi-objective problems using multi-mode radial basis functions
    Shen, Jiangtao
    Wang, Xinjing
    He, Ruixuan
    Tian, Ye
    Wang, Wenxin
    Wang, Peng
    Wen, Zhiwen
    COMPLEX & INTELLIGENT SYSTEMS, 2025, 11 (02)
  • [29] Surrogate-assisted evolutionary sampling particle swarm optimization for high-dimensional expensive optimization
    Huang, Kuihua
    Zhen, Huixiang
    Gong, Wenyin
    Wang, Rui
    Bian, Weiwei
    NEURAL COMPUTING & APPLICATIONS, 2023,
  • [30] Automated Filter Pruning Based on High-Dimensional Bayesian Optimization
    Kim, Taehyeon
    Choi, Heungjun
    Choe, Yoonsik
    IEEE ACCESS, 2022, 10 : 22547 - 22555