Particle swarm optimization based on temporal-difference learning for solving multi-objective optimization problems

被引：0
作者：
Desong Zhang
Guangyu Zhu
机构：
[1] Fuzhou University,School of Mechanical Engineering and Automation
来源：
Computing | 2023年 / 105卷
关键词：
Multi-objective optimization; Particle swarm optimization; Reinforcement learning; Temporal-difference learning; 68W50; 68Q32; 90C29;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Multi-objective evolutionary algorithms have become the most important method to deal with multi-objective optimization problems (MOP). To improve the performance of particle swarm optimization (PSO) in addressing MOPs, a multi-objective PSO based on temporal-difference learning (TDLMOPSO) is proposed in this paper. The iteration process of TDLMOPSO is transformed into a Markov decision process, particles are treated as agents, each agent has a personal archive, the states are designed for the connection of actions, the actions of particles contain all necessary behavior of them: basic movement, jump out of local optimum, and local search, and the rewards depend on the relationship between particles’ positions and their personal archives. Besides, the external archive deletion strategy and the leader selection strategy are redesigned based on the unsupervised learning algorithm to enhance the diversity of solutions in the external archive. The effectiveness of TDLMOPSO is verified by applying it with other seven advanced multi-objective algorithms in MOP benchmark test suites. Furthermore, the time complexity and parameter sensitivity of TDLMOPSO are analyzed.
引用
收藏
页码：1795 / 1820
页数：25
相关论文
共 86 条
  • [1] Zhu G-Y(2018)A fitness assignment strategy based on the grey and entropy parallel analysis and its application to MOEA Eur J Oper Res 265 813-828
  • [2] He L-J(2020)Optimal foraging algorithm that incorporates fuzzy relative entropy for solving many-objective permutation flow shop scheduling problems IEEE Trans Fuzzy Syst 28 2738-2746
  • [3] Ju X-W(2021)Multi-objective particle swarm optimization with adaptive strategies for feature selection Swarm Evol Comput 62 447-464
  • [4] Zhang W-B(2019)A novel two-archive strategy for evolutionary many-objective optimization algorithm based on reference points Appl Soft Comput 78 2794-2808
  • [5] Zhu G-Y(2017)An external archive-guided multiobjective particle swarm optimization algorithm IEEE Transa Cyber 47 10007-10032
  • [6] Ding C(2020)A rotationally invariant semi-autonomous particle swarm optimizer with directional diversity Swarm Evol Comput 56 298-312
  • [7] Zhang W-B(2020)A reinforcement learning-based communication topology in particle swarm optimization Neural Comput Appl 32 1977-2003
  • [8] Han F(2022)A reinforcement learning level-based particle swarm optimization algorithm for large-scale optimization Inf Sci 602 1545-1567
  • [9] Chen W-T(2022)Multi-objective particle swarm optimization with multi-mode collaboration based on reinforcement learning for path planning of unmanned air vehicles Knowl-Based Syst 250 786-798
  • [10] Ling Q-H(2020)A fitness landscape ruggedness multiobjective differential evolution algorithm with a reinforcement learning strategy Appl Soft Comput 96 63-76
123456789