Batched Data-Driven Evolutionary Multiobjective Optimization Based on Manifold Interpolation

被引:16
作者
Li, Ke [1 ,2 ]
Chen, Renzhi [3 ]
机构
[1] Univ Elect Sci & Technol China, Coll Comp Sci & Engn, Chengdu 611731, Peoples R China
[2] Univ Exeter, Dept Comp Sci, Exeter EX4 4QF, England
[3] PLA Acad Mil Sci, Natl Inst Def Technol Innovat, Beijing 100091, Peoples R China
基金
英国工程与自然科学研究理事会; 中国国家自然科学基金;
关键词
Optimization; Manifolds; Linear programming; Iron; Computational modeling; Search problems; Interpolation; Evolutionary algorithm (EA); Karush-Kuhn-Tucker (KKT) conditions; multiobjective optimization; surrogate modeling; BAYESIAN-APPROACH; ALGORITHMS; SURROGATE; MODEL; APPROXIMATION; CONVERGENCE; IMPROVEMENT; MULTIPLE; SINGLE;
D O I
10.1109/TEVC.2022.3162993
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multiobjective optimization problems are ubiquitous in real-world science, engineering, and design optimization problems. It is not uncommon that the objective functions are as a black box, the evaluation of which usually involve time-consuming and/or costly physical experiments. Data-driven evolutionary optimization can be used to search for a set of nondominated tradeoff solutions, where the expensive objective functions are approximated as a surrogate model. In this article, we propose a framework for implementing batched data-driven evolutionary multiobjective optimization (EMO). It is so general that any off-the-shelf EMO algorithms can be applied in a plug-in manner. There are two unique components: 1) based on the Karush-Kuhn-Tucker conditions, a manifold interpolation approach that explores more diversified solutions with a convergence guarantee along the manifold of the approximated Pareto-optimal set and 2) a batch recommendation approach that reduces the computational time of the data-driven evolutionary optimization process by evaluating multiple samples at a time in parallel. Comparing against seven state-of-the-art surrogate-assisted evolutionary algorithms, experiments on 168 benchmark test problem instances with various properties and a real-world application on hyper-parameter optimization fully demonstrate the effectiveness and superiority of our proposed framework, which is featured with a faster convergence and a stronger resilience to various Pareto-optimal front shapes.
引用
收藏
页码:126 / 140
页数:15
相关论文
共 70 条
  • [1] Towards faster convergence of evolutionary multi-criterion optimization algorithms using Karush Kuhn Tucker optimality based local search
    Abouhawwash, Mohamed
    Seada, Haitham
    Deb, Kalyanmoy
    [J]. COMPUTERS & OPERATIONS RESEARCH, 2017, 79 : 331 - 346
  • [2] Multi objective optimization of computationally expensive multi-modal functions with RBF surrogates and multi-rule selection
    Akhtar, Taimoor
    Shoemaker, Christine A.
    [J]. JOURNAL OF GLOBAL OPTIMIZATION, 2016, 64 (01) : 17 - 32
  • [3] Bradford E, 2018, J GLOBAL OPTIM, V71, P407, DOI 10.1007/s10898-018-0609-2
  • [4] Broomhead D. S., 1988, Complex Systems, V2, P321
  • [5] Test Problems for Large-Scale Multiobjective and Many-Objective Optimization
    Cheng, Ran
    Jin, Yaochu
    Olhofer, Markus
    Sendhoff, Bernhard
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2017, 47 (12) : 4108 - 4121
  • [6] A Surrogate-Assisted Reference Vector Guided Evolutionary Algorithm for Computationally Expensive Many-Objective Optimization
    Chugh, Tinkle
    Jin, Yaochu
    Miettinen, Kaisa
    Hakanen, Jussi
    Sindhya, Karthik
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2018, 22 (01) : 129 - 142
  • [7] Deb K, 2004, ADV INFO KNOW PROC, P105
  • [8] A fast and elitist multiobjective genetic algorithm: NSGA-II
    Deb, K
    Pratap, A
    Agarwal, S
    Meyarivan, T
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2002, 6 (02) : 182 - 197
  • [9] Deb K., 2001, WIL INT S SYS OPT
  • [10] A Computationally Fast Convergence Measure and Implementation for Single-, Multiple- and Many-Objective Optimization
    Deb, Kalyanmoy
    Abouhawwash, Mohamed
    Seada, Haitham
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2017, 1 (04): : 280 - 293