Research on Multi UAV Algorithm Based on Evolutionary Reinforcement Learning

被引:0
|
作者
Huang, Jingyi [1 ]
Cui, Yujie [1 ]
Wu, Shuying [1 ]
Yang, Ziyi [1 ]
Li, Bo [1 ]
Wang, Geng [1 ]
机构
[1] Northwestern Polytech Univ, 127 Youyi West Rd, Xian, Shaanxi, Peoples R China
来源
INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2024, PT II | 2025年 / 15202卷
关键词
Reinforcement Learning; IDQN; Evolutionary Learning; Generalization; Sparse Rewards;
D O I
10.1007/978-981-96-0774-7_33
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper explores and investigates the lack of exploration performance and generalization performance common to multi-intelligence reinforcement learning algorithms during multi-UAV cooperative reconnaissance to investigate the problem. The principle of evolutionary learning is proposed to improve the performance of the algorithms. Unlike traditional deep reinforcement learning, which typically struggles with tasks that have few rewards, evolutionary approaches excel in this context by reducing the risk of premature convergence. The key advantage is the inherent ability of evolutionary methods to incorporate prior knowledge, which significantly improves the algorithm's search and generalization capabilities. By integrating these evolutionary mechanisms, this research aims to improve the robustness and adaptability of IDQN algorithms. In this study, Airsim is used as a simulation experiment environment to meet the requirements of complex dynamic environments, and the experimental results show that evolutionary reinforcement learning effectively improves the performance of UAV model reconnaissance and achieves more effective decision-making in complex dynamic environments.
引用
收藏
页码:447 / 459
页数:13
相关论文
共 50 条
  • [1] A novel multi-state reinforcement learning-based multi-objective evolutionary algorithm
    Wang, Jing
    Zheng, Yuxin
    Zhang, Ziyun
    Peng, Hu
    Wang, Hui
    INFORMATION SCIENCES, 2025, 688
  • [2] Multi-UAV Collaborative Detection Based on Reinforcement Learning
    Hao, Yuanhui
    Guo, Chubing
    Ke, Liangjun
    ADVANCES IN SWARM INTELLIGENCE, PT I, ICSI 2024, 2024, 14788 : 463 - 474
  • [3] Reinforcement learning aided parameter control in multi-objective evolutionary algorithm based on decomposition
    Ning W.
    Guo B.
    Guo X.
    Li C.
    Yan Y.
    Progress in Artificial Intelligence, 2018, 7 (4) : 385 - 398
  • [4] Reinforcement learning-assisted evolutionary algorithm: A survey and research opportunities
    Song, Yanjie
    Wu, Yutong
    Guo, Yangyang
    Yan, Ran
    Suganthan, Ponnuthurai Nagaratnam
    Zhang, Yue
    Pedrycz, Witold
    Das, Swagatam
    Mallipeddi, Rammohan
    Ajani, Oladayo Solomon
    Feng, Qiang
    SWARM AND EVOLUTIONARY COMPUTATION, 2024, 86
  • [5] Multi-strategy multi-objective differential evolutionary algorithm with reinforcement learning
    Han, Yupeng
    Peng, Hu
    Mei, Changrong
    Cao, Lianglin
    Deng, Changshou
    Wang, Hui
    Wu, Zhijian
    KNOWLEDGE-BASED SYSTEMS, 2023, 277
  • [6] UAV reinforcement learning control algorithm with demonstrations
    Sun D.
    Gao D.
    Zheng J.
    Han P.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2023, 49 (06): : 1424 - 1433
  • [7] The Algorithm for UAV Obstacle Avoidance and Route Planning Based on Reinforcement Learning
    Liu, Jiantong
    Wang, Zhengjie
    Zhang, Zhide
    PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON MODELLING, IDENTIFICATION AND CONTROL (ICMIC2019), 2020, 582 : 747 - 754
  • [8] Reinforcement Learning-Based Cooperative Adversarial Algorithm for UAV Cluster
    Li, Yan
    Gao, Yanlong
    Dai, Xunhua
    Nian, Xiaohong
    Wang, Haibo
    Xiong, HongYun
    PROCEEDINGS OF 2022 INTERNATIONAL CONFERENCE ON AUTONOMOUS UNMANNED SYSTEMS, ICAUS 2022, 2023, 1010 : 1129 - 1138
  • [9] A reinforcement learning assisted evolutionary algorithm for constrained multi-task optimization
    Yang, Yufei
    Zhang, Changsheng
    Zhang, Bin
    Ning, Jiaxu
    INFORMATION SCIENCES, 2024, 678
  • [10] A deep reinforcement learning based distributed multi-UAV dynamic area coverage algorithm for complex environment
    Xiao, Jian
    Yuan, Guohui
    Xue, Yuxi
    He, Jinhui
    Wang, Yaoting
    Zou, Yuanjiang
    Wang, Zhuoran
    NEUROCOMPUTING, 2024, 595