Solving Multitask Optimization Problems With Adaptive Knowledge Transfer via Anomaly Detection

被引:86
作者
Wang, Chao [1 ]
Liu, Jing [1 ]
Wu, Kai [2 ]
Wu, Zhaoyang [1 ]
机构
[1] Xidian Univ, Guangzhou Inst Technol, Guangzhou 710071, Peoples R China
[2] Xidian Univ, Sch Artificial Intelligence, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Optimization; Statistics; Sociology; Knowledge transfer; Anomaly detection; Evolutionary computation; Adaptive strategy; anomaly detection; evolutionary multitask optimization (EMTO); knowledge transfer; many-task optimization (MaTO); EVOLUTIONARY MULTITASKING; ALGORITHM;
D O I
10.1109/TEVC.2021.3068157
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Evolutionary multitask optimization (EMTO) has recently attracted widespread attention in the evolutionary computation community, which solves two or more tasks simultaneously to improve the convergence characteristics of tasks when individually optimized. Effective knowledge between tasks is transferred by taking advantage of the parallelism of population-based search. Without any prior knowledge about tasks, it is a challenging problem of how to adaptively transfer effective knowledge between tasks and reduce the impact of negative transfer in EMTO. However, these two issues are rarely studied simultaneously in the existing literature. Besides, in complex many-task environments, the potential relationships among individuals from highly diverse populations associated with tasks directly determine the effectiveness of cross-task knowledge transfer. Keeping those in mind, we propose a multitask evolutionary algorithm based on anomaly detection (MTEA-AD). Specifically, each task is assigned a population and an anomaly detection model. Each anomaly detection model is used to learn the relationship among individuals between the current task and the other tasks online. Individuals that may carry negative knowledge are identified as outliers, and candidate transferred individuals identified by the anomaly detection model are selected to assist the current task, which may carry common knowledge across the current task and other tasks. Furthermore, to realize the adaptive control of the degree of knowledge transfer, the successfully transferred individuals that survive to the next generation through the elitism are used to update the anomaly detection parameter. The fair competition between offspring and candidate transferred individuals can effectively reduce the risk of negative transfer. Finally, the empirical studies on a series of synthetic benchmarks and a practical study are conducted to verify the effectiveness of MTEA-AD. The experimental results demonstrate that our proposal can adaptively adjust the degree of knowledge transfer through the anomaly detection model to achieve highly competitive performance compared to several state-of-the-art EMTO methods.
引用
收藏
页码:304 / 318
页数:15
相关论文
共 48 条
[11]  
Deb K., 1995, Complex Systems, V9, P115
[12]  
Deb K., 1996, Comput. Sci. Inform, V26, P30, DOI DOI 10.1109/TEVC.2007.895269
[13]   Generalized Multitasking for Evolutionary Optimization of Expensive Problems [J].
Ding, Jinliang ;
Yang, Cuie ;
Jin, Yaochu ;
Chai, Tianyou .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2019, 23 (01) :44-58
[14]  
Eberhart R., 1995, P 6 INT S MICR HUM S, P39, DOI [10.1109/MHS.1995.494215, DOI 10.1109/MHS.1995.494215]
[15]  
Feng L, 2017, IEEE C EVOL COMPUTAT, P921, DOI 10.1109/CEC.2017.7969407
[16]   Explicit Evolutionary Multitasking for Combinatorial Optimization: A Case Study on Capacitated Vehicle Routing Problem [J].
Feng, Liang ;
Huang, Yuxiao ;
Zhou, Lei ;
Zhong, Jinghui ;
Gupta, Abhishek ;
Tang, Ke ;
Tan, Kay Chen .
IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (06) :3143-3156
[17]   Evolutionary Multitasking via Explicit Autoencoding [J].
Feng, Liang ;
Zhou, Lei ;
Zhong, Jinghui ;
Gupta, Abhishek ;
Ong, Yew-Soon ;
Tan, Kay-Chen ;
Qin, A. K. .
IEEE TRANSACTIONS ON CYBERNETICS, 2019, 49 (09) :3457-3470
[18]   Multiobjective Multifactorial Optimization in Evolutionary Multitasking [J].
Gupta, Abhishek ;
Ong, Yew-Soon ;
Feng, Liang ;
Tan, Kay Chen .
IEEE TRANSACTIONS ON CYBERNETICS, 2017, 47 (07) :1652-1665
[19]  
Gupta A, 2015, COMPLEX INTELL SYST, V1, P83, DOI 10.1007/s40747-016-0011-y
[20]   Multifactorial Evolution: Toward Evolutionary Multitasking [J].
Gupta, Abhishek ;
Ong, Yew-Soon ;
Feng, Liang .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2016, 20 (03) :343-357