A Multipopulation Evolutionary Algorithm for Solving Large-Scale Multimodal Multiobjective Optimization Problems

被引:85
作者
Tian, Ye [1 ]
Liu, Ruchen [2 ]
Zhang, Xingyi [2 ]
Ma, Haiping [1 ]
Tan, Kay Chen [3 ]
Jin, Yaochu [4 ]
机构
[1] Anhui Univ, Inst Phys Sci & Informat Technol, Minist Educ, Key Lab Intelligent Comp & Signal Proc, Hefei 230601, Peoples R China
[2] Anhui Univ, Sch Comp Sci & Technol, Key Lab Intelligent Comp & Signal Proc, Minist Educ, Hefei 230601, Peoples R China
[3] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[4] Univ Surrey, Dept Comp Sci, Guildford GU2 7XH, Surrey, England
基金
中国国家自然科学基金;
关键词
Computer architecture; Pareto optimization; Statistics; Sociology; Microprocessors; Optimization; Extraterrestrial measurements; Evolutionary algorithm (EA); large-scale optimization; multimodal multiobjective optimization; neural architecture search; sparse Pareto-optimal solutions; FRAMEWORK;
D O I
10.1109/TEVC.2020.3044711
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multimodal multiobjective optimization problems (MMOPs) widely exist in real-world applications, which have multiple equivalent Pareto-optimal solutions that are similar in the objective space but totally different in the decision space. While some evolutionary algorithms (EAs) have been developed to find the equivalent Pareto-optimal solutions in recent years, they are ineffective to handle large-scale MMOPs having a large number of variables. This article thus proposes an EA for solving large-scale MMOPs with sparse Pareto-optimal solutions, i.e., most variables in the optimal solutions are 0. The proposed algorithm explores different regions of the decision space via multiple subpopulations and guides the search behavior of the subpopulations via adaptively updated guiding vectors. The guiding vector for each subpopulation not only provides efficient convergence in the huge search space but also differentiates its search direction from others to handle the multimodality. While most existing EAs solve MMOPs with 2-7 decision variables, the proposed algorithm is shown to be effective for benchmark MMOPs with up to 500 decision variables. Moreover, the proposed algorithm also produces a better result than state-of-the-art methods for the neural architecture search.
引用
收藏
页码:405 / 418
页数:14
相关论文
共 68 条
[11]  
Frazao X, 2014, LECT NOTES COMPUT SC, V8827, P674, DOI 10.1007/978-3-319-12568-8_82
[12]   Distributed Differential Evolution Based on Adaptive Mergence and Split for Large-Scale Optimization [J].
Ge, Yong-Feng ;
Yu, Wei-Jie ;
Lin, Ying ;
Gong, Yue-Jiao ;
Zhan, Zhi-Hui ;
Chen, Wei-Neng ;
Zhang, Jun .
IEEE TRANSACTIONS ON CYBERNETICS, 2018, 48 (07) :2166-2180
[13]   Learning Multimodal Parameters: A Bare-Bones Niching Differential Evolution Approach [J].
Gong, Yue-Jiao ;
Zhang, Jun ;
Zhou, Yicong .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (07) :2944-2959
[14]   Accelerating Large-Scale Multiobjective Optimization via Problem Reformulation [J].
He, Cheng ;
Li, Lianghao ;
Tian, Ye ;
Zhang, Xingyi ;
Cheng, Ran ;
Jin, Yaochu ;
Yao, Xin .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2019, 23 (06) :949-961
[15]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[16]  
Hu C, 2018, P GEN EV COMP C COMP
[17]   Densely Connected Convolutional Networks [J].
Huang, Gao ;
Liu, Zhuang ;
van der Maaten, Laurens ;
Weinberger, Kilian Q. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2261-2269
[18]  
Ishibuchi Hisao, 2019, 2019 IEEE Congress on Evolutionary Computation (CEC). Proceedings, P310, DOI 10.1109/CEC.2019.8789971
[19]   Pareto-based multiobjective machine learning: An overview and case studies [J].
Jin, Yaochu ;
Sendhoff, Bernhard .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2008, 38 (03) :397-415
[20]   The relative performance of ensemble methods with deep convolutional neural networks for image classification [J].
Ju, Cheng ;
Bibaut, Aurelien ;
van der Laan, Mark .
JOURNAL OF APPLIED STATISTICS, 2018, 45 (15) :2800-2818