Evolutionary Optimization Framework Based on Transfer Learning of Similar Historical Information

被引:0
作者
Zhang Y. [1 ]
Yang K. [1 ]
Hao G.-S. [2 ]
Gong D.-W. [1 ]
机构
[1] School of Information and Control Engineering, China University of Mining and Technology, Xuzhou
[2] School of Computer Science and Technology, Jiangsu Normal University, Xuzhou
来源
Zidonghua Xuebao/Acta Automatica Sinica | 2021年 / 47卷 / 03期
基金
中国国家自然科学基金;
关键词
Evolutionary optimization; Model matching; Particle swarm optimization (PSO); Transfer learning;
D O I
10.16383/j.aas.c180515
中图分类号
学科分类号
摘要
Most of existing evolutionary algorithms search optimal solutions from zero initial information of a given problem. Because of the lacking a mechanism to use historical information, this must waste computing resources to some extent when solving a problem similar to old ones. This paper extends the idea of transfer learning to the field of evolutionary optimization, and studies a new evolutionary optimization framework based the transfer learning of similar historical information. To improve the search efficiency of the population, the proposed framework finds out the history problem from the model library, which matches current new problem, and transfers the knowledge of the historical problem into optimization process of the new problem. First, a maximum mean discrepancy indicator based on multi-distribution estimation is defined to evaluate the matching degree between a new problem and historical models. Secondly, the knowledge of matched historical problem is transferred into the new problem, and a new initialization strategy of the population based on matching degree is given to accelerate the search speed of the algorithm. Next, a preservation strategy based on iterative clustering is presented to save good information generated during the evolutionary process, for updating the model library. Finally, embedding an adaptive bare-bones particle swarm optimization (PSO) into the proposed framework, a bare-bones PSO algorithm based on the transfer learning of similar historical information is presented. Testing on several improved typical functions, experimental results show that the proposed transfer strategy accelerates the search process of the particle swarm, and significantly improve the convergence speed and the search efficiency of the proposed PSO algorithm. Copyright © 2021 Acta Automatica Sinica. All rights reserved.
引用
收藏
页码:652 / 665
页数:13
相关论文
共 33 条
[1]  
Li Yuan-Cheng, Li Zong-Pu, Yang Li-Qun, Wang Bei, Re- active power optimization of distribution network with distributed power supply based on improved quantum difference evolution, Acta Automatica Sinica, 43, 7, pp. 1280-1288, (2017)
[2]  
Yu Wei-Wei, Xie Cheng-Wang, Bi Ying-Zhou, Xia Xue- Wen, Li Xiong, Ren Ke-Yan, Zhao Huai-Rui, Wang Shao- Feng, Many-objective particle swarm optimization based on adaptive fuzzy dominance, Acta Automatica Sinica, 44, 12, pp. 2278-2289, (2018)
[3]  
Wang Dong-Feng, Meng Li, Performance analysis and parameter selection of PSO algorithms, Acta Automatica Sinica, 42, 10, pp. 1552-1561, (2016)
[4]  
Tang L, Wang X., A hybrid multiobjective evolutionary algorithm for multiobjective optimization problems, IEEE Transactions on Evolutionary Computation, 17, 1, pp. 20-45, (2013)
[5]  
Tian Meng-Chu, Bo Yu-Ming, Chen Zhi-Min, Wu Pan- Long, Zhao Gao-Peng, Firefly algorithm intelligence optimized particle filter, Acta Automatica Sinica, 42, 1, pp. 89-97, (2016)
[6]  
Xu Mao-Xin, Zhang Xiao-Shun, Yu Tao, Transfer bees optimizer and its application on reactive power optimization, Acta Automatica Sinica, 43, 1, pp. 83-93, (2017)
[7]  
Zhang X Y, Tian Y, Cheng R, Jin Y C., An efficient approach to nondominated sorting for evolutionary multiobjective optimization, IEEE Transactions on Evolutionary Computation, 19, 2, pp. 201-213, (2015)
[8]  
Patvardhan C, Bansal S, Srivastav A., Quantum-inspired evolutionary algorithm for diffcult knapsack problems, Memetic Computing, 7, 2, pp. 135-155, (2015)
[9]  
Pan S J, Yang Q., A survey on transfer learning, IEEE Trans- actions on Knowledge and Data Engineering, 22, 10, pp. 1345-1359, (2010)
[10]  
Murre J M J., Transfer of learning in backpropagation and in related neural network models, Connectionist Models of Memory and Language, pp. 73-93, (1995)