Multi-UAV Cooperative Target Assignment Method Based on Reinforcement Learning

被引:0
|
作者
Ding, Yunlong [1 ]
Kuang, Minchi [1 ,2 ]
Shi, Heng [2 ]
Gao, Jiazhan [1 ]
机构
[1] Xinjiang Univ, Sch Comp Sci & Technol, Urumqi 830046, Peoples R China
[2] Tsinghua Univ, Precis Instruments Dept, Beijing 100084, Peoples R China
关键词
target assignment; multi-UAV air combat; reinforcement learning; attention mechanism; PPO;
D O I
10.3390/drones8100562
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
To overcome the problems of traditional distributed target allocation algorithms in terms of lack of target strategic priority, poor scalability, and robustness, this paper proposes a proximal strategy optimization algorithm that combines threat assessment and attention mechanism (TAPPO). Based on the distributed training framework, the algorithm integrates a threat assessment and dynamic attention strategy and designs a dynamic reward function based on the current hit rate of the drone and the missile benefit ratio to improve the algorithm's exploration ability and scalability. Through an 8vs8 multi-UAV confrontation experiment in a digital twin simulation environment, the results show that the agent using the TAPPO algorithm for target allocation defeats the state machine with an 85% winning rate and is significantly better than other current mainstream target allocation algorithms, verifying the effectiveness of the algorithm.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] A Method of Multi-UAV Cooperative Task Assignment Based on Reinforcement Learning
    Zhao, Xiaohu
    Jiang, Hanli
    An, Chenyang
    Wu, Ruocheng
    Guo, Yijun
    Yang, Daquan
    MOBILE INFORMATION SYSTEMS, 2022, 2022
  • [2] Joint Optimization of Multi-UAV Target Assignment and Path Planning Based on Multi-Agent Reinforcement Learning
    Qie, Han
    Shi, Dianxi
    Shen, Tianlong
    Xu, Xinhai
    Li, Yuan
    Wang, Liujing
    IEEE ACCESS, 2019, 7 : 146264 - 146272
  • [3] Deep Reinforcement Learning Based Computation Offloading and Trajectory Planning for Multi-UAV Cooperative Target Search
    Luo, Quyuan
    Luan, Tom H.
    Shi, Weisong
    Fan, Pingzhi
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (02) : 504 - 520
  • [4] Multi-UAV Escape Target Search: A Multi-Agent Reinforcement Learning Method
    Liao, Guang
    Wang, Jian
    Yang, Dujia
    Yang, Junan
    SENSORS, 2024, 24 (21)
  • [5] A Cooperative Task Assignment Method of Multi-UAV Based on Self Organizing Map
    Zhu, Shurong
    Zhang, Yingzhou
    Gao, Yang
    Wu, Fan
    2018 INTERNATIONAL CONFERENCE ON CYBER-ENABLED DISTRIBUTED COMPUTING AND KNOWLEDGE DISCOVERY (CYBERC 2018), 2018, : 437 - 442
  • [6] Reinforcement Learning based Approach for Multi-UAV Cooperative Searching in Unknown Environments
    Yue, Wei
    Guan, Xianhe
    Xi, Yun
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 2018 - 2023
  • [7] Cooperative task assignment of multi-UAV system
    Jun ZHANG
    Jiahao XING
    Chinese Journal of Aeronautics , 2020, (11) : 2825 - 2827
  • [8] Cooperative task assignment of multi-UAV system
    Jun ZHANG
    Jiahao XING
    Chinese Journal of Aeronautics, 2020, 33 (11) : 2825 - 2827
  • [9] Multi-UAV Cooperative Task Assignment Based on Half Random Q-Learning
    Zhu, Pengxing
    Fang, Xi
    SYMMETRY-BASEL, 2021, 13 (12):
  • [10] Cooperative task assignment of multi-UAV system
    Zhang, Jun
    Xing, Jiahao
    CHINESE JOURNAL OF AERONAUTICS, 2020, 33 (11) : 2825 - 2827