Research on Multi UAV Algorithm Based on Evolutionary Reinforcement Learning

被引:0
作者
Huang, Jingyi [1 ]
Cui, Yujie [1 ]
Wu, Shuying [1 ]
Yang, Ziyi [1 ]
Li, Bo [1 ]
Wang, Geng [1 ]
机构
[1] Northwestern Polytech Univ, 127 Youyi West Rd, Xian, Shaanxi, Peoples R China
来源
INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2024, PT II | 2025年 / 15202卷
关键词
Reinforcement Learning; IDQN; Evolutionary Learning; Generalization; Sparse Rewards;
D O I
10.1007/978-981-96-0774-7_33
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper explores and investigates the lack of exploration performance and generalization performance common to multi-intelligence reinforcement learning algorithms during multi-UAV cooperative reconnaissance to investigate the problem. The principle of evolutionary learning is proposed to improve the performance of the algorithms. Unlike traditional deep reinforcement learning, which typically struggles with tasks that have few rewards, evolutionary approaches excel in this context by reducing the risk of premature convergence. The key advantage is the inherent ability of evolutionary methods to incorporate prior knowledge, which significantly improves the algorithm's search and generalization capabilities. By integrating these evolutionary mechanisms, this research aims to improve the robustness and adaptability of IDQN algorithms. In this study, Airsim is used as a simulation experiment environment to meet the requirements of complex dynamic environments, and the experimental results show that evolutionary reinforcement learning effectively improves the performance of UAV model reconnaissance and achieves more effective decision-making in complex dynamic environments.
引用
收藏
页码:447 / 459
页数:13
相关论文
共 50 条
  • [11] Efficient Elitist Cooperative Evolutionary Algorithm for Multi-Objective Reinforcement Learning
    Zhou, Dan
    Du, Jiqing
    Arai, Sachiyo
    IEEE ACCESS, 2023, 11 (43128-43139) : 43128 - 43139
  • [12] A Collaborative Migration Algorithm for Edge Services Based on Evolutionary Reinforcement Learning
    Zuo, Yanan
    Zhang, Xiuguo
    Zhang, Bo
    Cao, Zhiying
    ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2023, PT VII, 2024, 14493 : 47 - 66
  • [13] Reinforcement Learning-Based UAV Handover Algorithm in Cellular Networks : A Survey
    Kim, Gahyun
    Kim, Jaemin
    Hong, Seonghun
    Cho, Sungrae
    2024 FIFTEENTH INTERNATIONAL CONFERENCE ON UBIQUITOUS AND FUTURE NETWORKS, ICUFN 2024, 2024, : 58 - 60
  • [14] Multi-UAV Cooperative Target Assignment Method Based on Reinforcement Learning
    Ding, Yunlong
    Kuang, Minchi
    Shi, Heng
    Gao, Jiazhan
    DRONES, 2024, 8 (10)
  • [15] UAV Path Planning Based on Multi-Layer Reinforcement Learning Technique
    Cui, Zhengyang
    Wang, Yong
    IEEE ACCESS, 2021, 9 : 59486 - 59497
  • [16] Optimization Design of Multi-UAV Communication Network Based on Reinforcement Learning
    Cao, Zhengyang
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [17] Reinforcement Learning Based Trajectory Planning for Multi-UAV Load Transportation
    Estevez, Julian
    Manuel Lopez-Guede, Jose
    del Valle-Echavarri, Javier
    Grana, Manuel
    IEEE ACCESS, 2024, 12 : 144009 - 144016
  • [18] A Reinforcement Learning based evolutionary multi-objective optimization algorithm for spectrum allocation in Cognitive Radio networks
    Kaur, Amandeep
    Kumar, Krishan
    PHYSICAL COMMUNICATION, 2020, 43
  • [19] Research on cooperative collision avoidance problem of multiple UAV based on Reinforcement Learning
    Fang Bin
    Feng XiaoFeng
    Xu Shuo
    2017 10TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTATION TECHNOLOGY AND AUTOMATION (ICICTA 2017), 2017, : 103 - 109
  • [20] Multi-agent cooperative learning research based on reinforcement learning
    Liu, Fei
    Zeng, Guangzhou
    2006 10TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, PROCEEDINGS, VOLS 1 AND 2, 2006, : 1408 - 1413