Theoretical Analyses of Multiobjective Evolutionary Algorithms on Multimodal Objectives

被引:5
作者
Zheng, Weijie [1 ]
Doerr, Benjamin [2 ]
机构
[1] Harbin Inst Technol, Int Res Inst Artificial Intelligence, Sch Comp Sci & Technol, Shenzhen, Peoples R China
[2] Inst Polytech Paris, Ecole Polytech, CNRS, Lab Informat LIX, Palaiseau, France
关键词
Multiobjective evolutionary algorithms; multimodal problems; theory of computing; runtime analysis; EXPECTED RUNTIMES; SELECTION; CROSSOVER;
D O I
10.1162/evco_a_00328
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multiobjective evolutionary algorithms are successfully applied in many real-world multiobjective optimization problems. As for many other AI methods, the theoretical understanding of these algorithms is lagging far behind their success in practice. In particular, previous theory work considers mostly easy problems that are composed of unimodal objectives.As a first step towards a deeper understanding of how evolutionary algorithms solve multimodal multiobjective problems, we propose the OneJumpZeroJump problem, a bi-objective problem composed of two objectives isomorphic to the classic jump function benchmark. We prove that the simple evolutionary multiobjective optimizer (SEMO) with probability one does not compute the full Pareto front, regardless of the runtime. In contrast, for all problem sizes n and all jump sizes k is an element of[4..n/2-1], the global SEMO (GSEMO) covers the Pareto front in an expected number of Theta((n-2k)n(k)) iterations. For k=o(n), we also show the tighter bound 3/2en(k+1)+/- o(n(k+1)), which might be the first runtime bound for an MOEA that is tight apart from lower-order terms. We also combine the GSEMO with two approaches that showed advantages in single-objective multimodal problems. When using the GSEMO with a heavy-tailed mutation operator, the expected runtime improves by a factor of at least k(Omega(k)). When adapting the recent stagnation-detection strategy of Rajabi and Witt (2022) to the GSEMO, the expected runtime also improves by a factor of at least k(Omega(k)) and surpasses the heavy-tailed GSEMO by a small polynomial factor in k. Via an experimental analysis, we show that these asymptotic differences are visible already for small problem sizes: A factor-5 speed-up from heavy-tailed mutation and a factor-10 speed-up from stagnation detection can be observed already for jump size 4 and problem sizes between 10 and 50. Overall, our results show that the ideas recently developed to aid single-objective evolutionary algorithms to cope with local optima can be effectively employed also in multiobjective optimization.
引用
收藏
页码:337 / 373
页数:37
相关论文
共 74 条
[51]  
Neumann F, 2020, THEORY EVOLUTIONARY, DOI DOI 10.1007/978-3-030-29414-4
[52]  
Neumann F, 2008, LECT NOTES COMPUT SC, V5199, P72, DOI 10.1007/978-3-540-87700-4_8
[53]   Expected runtimes of a simple evolutionary algorithm for the multi-objective minimum spanning tree problem [J].
Neumann, Frank .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2007, 181 (03) :1620-1629
[54]  
Neumann F, 2010, LECT NOTES COMPUT SC, V6238, P667, DOI 10.1007/978-3-642-15844-5_67
[55]   Design and analysis of diversity-based parent selection schemes for speeding up evolutionary multi-objective optimisation [J].
Osuna, Edgar Covantes ;
Gao, Wanru ;
Neumann, Frank ;
Sudholt, Dirk .
THEORETICAL COMPUTER SCIENCE, 2020, 832 :123-142
[56]  
Preuss M, 2015, NAT COMPUT SER, P1, DOI 10.1007/978-3-319-07407-8
[57]  
Qian C, 2020, AAAI CONF ARTIF INTE, V34, P2408
[58]  
Qian C, 2018, AAAI CONF ARTIF INTE, P1395
[59]  
Qian C, 2015, PROCEEDINGS OF THE TWENTY-FOURTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI), P389
[60]   Selection Hyper-heuristics Can Provably Be Helpful in Evolutionary Multi-objective Optimization [J].
Qian, Chao ;
Tang, Ke ;
Zhou, Zhi-Hua .
PARALLEL PROBLEM SOLVING FROM NATURE - PPSN XIV, 2016, 9921 :835-846