An Exploitation-Enhanced Bayesian Optimization Algorithm for High-Dimensional Expensive Problems

被引:0
作者
Gui, Yuqian [1 ]
Zhan, Dawei [1 ]
Li, Tianrui [1 ]
机构
[1] Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China
来源
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT III | 2023年 / 14256卷
关键词
Expensive optimization; Bayesian optimization; Expected improvement; Local model; EFFICIENT GLOBAL OPTIMIZATION;
D O I
10.1007/978-3-031-44213-1_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Bayesian optimization (BO) algorithm is widely used to solve expensive optimization problems. However, when dealing with high-dimensional problems, the accuracy of the global Gaussian process (GP) model is often inadequate due to the limited number of training points. As a result, the search based on the expected improvement criterion can lead to misguided exploration. To address this issue, we propose an exploitation-enhanced Bayesian optimization (EE-BO) algorithm. Our approach incorporates a local GP model built around the evaluated solution from the previous iteration, which is used to find the next infill solution if the current selection from the global GP model is not an improvement. The inclusion of the local model mitigates the impact of inaccurate models and enhances the algorithm's ability to perform local searches when the global model struggles to find better solutions. Our numerical experiments show that the proposed EE-BO algorithm outperforms the vanilla BO algorithm and achieves competitive performance compared to five state-of-the-art algorithms.
引用
收藏
页码:295 / 306
页数:12
相关论文
共 50 条
  • [31] High-Dimensional Analog Circuit Sizing via Bayesian Optimization in the Variational Autoencoder Enhanced Latent Space
    Li, Wangzhen
    Bi, Zhaori
    Zeng, Xuan
    [J]. 2024 INTERNATIONAL SYMPOSIUM OF ELECTRONICS DESIGN AUTOMATION, ISEDA 2024, 2024, : 193 - 197
  • [32] A parallel constrained efficient global optimization algorithm for expensive constrained optimization problems
    Qian, Jiachang
    Cheng, Yuansheng
    Zhang, Jinlan
    Liu, Jun
    Zhan, Dawei
    [J]. ENGINEERING OPTIMIZATION, 2021, 53 (02) : 300 - 320
  • [33] High-Dimensional Bayesian Optimization via Random Projection of Manifold Subspaces
    Nguyen, Quoc-Anh Hoang
    The Hung Tran
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES-RESEARCH TRACK AND DEMO TRACK, PT VIII, ECML PKDD 2024, 2024, 14948 : 288 - 305
  • [34] High-dimensional multi-fidelity Bayesian optimization for quantum control
    Lazin, Marjuka F.
    Shelton, Christian R.
    Sandhofer, Simon N.
    Wong, Bryan M.
    [J]. MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2023, 4 (04):
  • [35] High-Dimensional Bayesian Optimization with Multi-Task Learning for RocksDB
    Alabed, Sami
    Yoneki, Eiko
    [J]. PROCEEDINGS OF THE 1ST WORKSHOP ON MACHINE LEARNING AND SYSTEMS (EUROMLSYS'21), 2021, : 111 - 119
  • [36] High-Dimensional Bayesian Optimization Using Both Random and Supervised Embeddings
    Priem, Remy
    Diouane, Youssef
    Bartoli, Nathalie
    Dubreuil, Sylvain
    Saves, Paul
    [J]. AIAA JOURNAL, 2024, : 162 - 173
  • [37] Surrogate-guided differential evolution algorithm for high dimensional expensive problems
    Cai, Xiwen
    Gao, Liang
    Li, Xinyu
    Qiu, Haobo
    [J]. SWARM AND EVOLUTIONARY COMPUTATION, 2019, 48 : 288 - 311
  • [38] EXTENDING EXPECTED IMPROVEMENT FOR HIGH-DIMENSIONAL STOCHASTIC OPTIMIZATION OF EXPENSIVE BLACK-BOX FUNCTIONS
    Pandita, Piyush
    Bilionis, Ilias
    Panchal, Jitesh
    [J]. PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, 2016, VOL 2B, 2016, : 693 - 704
  • [39] Extending Expected Improvement for High-Dimensional Stochastic Optimization of Expensive Black-Box Functions
    Pandita, Piyush
    Bilionis, Ilias
    Panchal, Jitesh
    [J]. JOURNAL OF MECHANICAL DESIGN, 2016, 138 (11)
  • [40] Bi-objective Bayesian optimization of engineering problems with cheap and expensive cost functions
    Loka, Nasrulloh
    Couckuyt, Ivo
    Garbuglia, Federico
    Spina, Domenico
    Van Nieuwenhuyse, Inneke
    Dhaene, Tom
    [J]. ENGINEERING WITH COMPUTERS, 2023, 39 (03) : 1923 - 1933