Dynamic multi-strategy integrated differential evolution algorithm based on reinforcement learning for optimization problems

被引:1
|
作者
Yang, Qingyong [1 ]
Chu, Shu-Chuan [1 ]
Pan, Jeng-Shyang [1 ,2 ]
Chou, Jyh-Horng [3 ,4 ]
Watada, Junzo [5 ]
机构
[1] Shandong Univ Sci & Technol, Coll Comp Sci & Engn, Qingdao 266590, Peoples R China
[2] Chaoyang Univ Technol, Dept Informat Management, Taichung, Taiwan
[3] Kaohsiung Med Univ, Dept Healthcare Adm & Med Informat, Kaohsiung 807, Taiwan
[4] Feng Chia Univ, Dept Mech & Comp Aided Engn, Taichung 407, Taiwan
[5] Waseda Univ, Grad Sch Informat Prod & Syst, Kitakyushu 8080135, Japan
关键词
Differential evolution; Multi-population; Population diversity; Reinforcement learning; Individual dynamic migration; MUTATION STRATEGY; ENSEMBLE; SEARCH; PARAMETERS; SOLVE;
D O I
10.1007/s40747-023-01243-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The introduction of a multi-population structure in differential evolution (DE) algorithm has been proven to be an effective way to achieve algorithm adaptation and multi-strategy integration. However, in existing studies, the mutation strategy selection of each subpopulation during execution is fixed, resulting in poor self-adaptation of subpopulations. To solve this problem, a dynamic multi-strategy integrated differential evolution algorithm based on reinforcement learning (RLDMDE) is proposed in this paper. By employing reinforcement learning, each subpopulation can adaptively select the mutation strategy according to the current environmental state (population diversity). Based on the population state, this paper proposes an individual dynamic migration strategy to "reward" or "punish" the population to avoid wasting individual computing resources. Furthermore, this paper applies two methods of good point set and random opposition-based learning (ROBL) in the population initialization stage to improve the quality of the initial solutions. Finally, to evaluate the performance of the RLDMDE algorithm, this paper selects two benchmark function sets, CEC2013 and CEC2017, and six engineering design problems for testing. The results demonstrate that the RLDMDE algorithm has good performance and strong competitiveness in solving optimization problems.
引用
收藏
页码:1845 / 1877
页数:33
相关论文
共 50 条
  • [1] Dynamic multi-strategy integrated differential evolution algorithm based on reinforcement learning for optimization problems
    Qingyong Yang
    Shu-Chuan Chu
    Jeng-Shyang Pan
    Jyh-Horng Chou
    Junzo Watada
    Complex & Intelligent Systems, 2024, 10 : 1845 - 1877
  • [2] Multi-strategy multi-objective differential evolutionary algorithm with reinforcement learning
    Han, Yupeng
    Peng, Hu
    Mei, Changrong
    Cao, Lianglin
    Deng, Changshou
    Wang, Hui
    Wu, Zhijian
    KNOWLEDGE-BASED SYSTEMS, 2023, 277
  • [3] Prediction based Multi-strategy Differential Evolution Algorithm for Dynamic Environments
    Wan, Shuzhen
    Xiong, Shengwu
    Liu, Yi
    2012 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2012,
  • [4] Differential evolution algorithm with multi-population cooperation and multi-strategy integration
    Li, Xiaoyu
    Wang, Lei
    Jiang, Qiaoyong
    Li, Ning
    NEUROCOMPUTING, 2021, 421 : 285 - 302
  • [5] Reinforcement learning-based differential evolution algorithm for constrained multi-objective optimization problems
    Yu, Xiaobing
    Xu, Pingping
    Wang, Feng
    Wang, Xuming
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 131
  • [6] Multi-strategy self-learning particle swarm optimization algorithm based on reinforcement learning
    Meng, Xiaoding
    Li, Hecheng
    Chen, Anshan
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (05) : 8498 - 8530
  • [7] Differential evolution based on strategy adaptation and deep reinforcement learning for multimodal optimization problems
    Liao, Zuowen
    Pang, Qishuo
    Gu, Qiong
    SWARM AND EVOLUTIONARY COMPUTATION, 2024, 87
  • [8] Multi-strategy Differential Evolution
    Yaman, Anil
    Iacca, Giovanni
    Coler, Matt
    Fletcher, George
    Pechenizkiy, Mykola
    APPLICATIONS OF EVOLUTIONARY COMPUTATION, EVOAPPLICATIONS 2018, 2018, 10784 : 617 - 633
  • [9] A Multi-Strategy Differential Evolution Algorithm with Adaptive Similarity Selection Rule
    Zheng, Liming
    Wen, Yinan
    SYMMETRY-BASEL, 2023, 15 (09):
  • [10] Multi-strategy fusion differential evolution algorithm for UAV path planning in complex environment
    Chai, Xuzhao
    Zheng, Zhishuai
    Xiao, Junming
    Yan, Li
    Qu, Boyang
    Wen, Pengwei
    Wang, Haoyu
    Zhou, You
    Sun, Hang
    AEROSPACE SCIENCE AND TECHNOLOGY, 2022, 121