Multi-UAV Redeployment Optimization Based on Multi-Agent Deep Reinforcement Learning Oriented to Swarm Performance Restoration

被引:1
作者
Wu, Qilong [1 ]
Geng, Zitao [1 ]
Ren, Yi [1 ]
Feng, Qiang [1 ]
Zhong, Jilong [2 ]
机构
[1] Beihang Univ, Sch Reliabil & Syst Engn, Beijing 100191, Peoples R China
[2] Def Innovat Inst, Acad Mil Sci, Beijing 100071, Peoples R China
基金
中国国家自然科学基金;
关键词
distributed reconfiguration strategy; multi-agent deep reinforcement learning; unmanned aerial vehicle (UAV); UAV swarm redeployment; COVERAGE;
D O I
10.3390/s23239484
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Distributed artificial intelligence is increasingly being applied to multiple unmanned aerial vehicles (multi-UAVs). This poses challenges to the distributed reconfiguration (DR) required for the optimal redeployment of multi-UAVs in the event of vehicle destruction. This paper presents a multi-agent deep reinforcement learning-based DR strategy (DRS) that optimizes the multi-UAV group redeployment in terms of swarm performance. To generate a two-layer DRS between multiple groups and a single group, a multi-agent deep reinforcement learning framework is developed in which a QMIX network determines the swarm redeployment, and each deep Q-network determines the single-group redeployment. The proposed method is simulated using Python and a case study demonstrates its effectiveness as a high-quality DRS for large-scale scenarios.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Multi-agent Deep Reinforcement Learning-based Trajectory Design for UAV-aided Edge Computing System
    Lu, Gengyuan
    Chang, Zheng
    2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC, 2023,
  • [42] Optimization of multi-echelon spare parts inventory systems using multi-agent deep reinforcement learning
    Zhou, Yifan
    Guo, Kai
    Yu, Cheng
    Zhang, Zhisheng
    APPLIED MATHEMATICAL MODELLING, 2024, 125 : 827 - 844
  • [43] UAV-to-Device Underlay Communications: Age of Information Minimization by Multi-Agent Deep Reinforcement Learning
    Wu, Fanyi
    Zhang, Hongliang
    Wu, Jianjun
    Han, Zhu
    Poor, H. Vincent
    Song, Lingyang
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (07) : 4461 - 4475
  • [44] UAV-Assisted Fair Communication for Mobile Networks: A Multi-Agent Deep Reinforcement Learning Approach
    Zhou, Yi
    Jin, Zhanqi
    Shi, Huaguang
    Wang, Zhangyun
    Lu, Ning
    Liu, Fuqiang
    REMOTE SENSING, 2022, 14 (22)
  • [45] Multi-UAV Hierarchical Intelligent Traffic Offloading Network Optimization Based on Deep Federated Learning
    Li, Fengqi
    Zhang, Kaiyang
    Wang, Jiaheng
    Li, Yudong
    Xu, Fengqiang
    Wang, Yanjuan
    Tong, Ning
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (12): : 21312 - 21324
  • [46] Multi-timescale voltage control for distribution system based on multi-agent deep reinforcement learning
    Wu, Zhi
    Li, Yiqi
    Gu, Wei
    Dong, Zengbo
    Zhao, Jingtao
    Liu, Weiliang
    Zhang, Xiao-Ping
    Liu, Pengxiang
    Sun, Qirun
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2023, 147
  • [47] Scalable and Cooperative Deep Reinforcement Learning Approaches for Multi-UAV Systems: A Systematic Review
    Frattolillo, Francesco
    Brunori, Damiano
    Iocchi, Luca
    DRONES, 2023, 7 (04)
  • [48] Minimum Throughput Maximization for Multi-UAV Enabled WPCN: A Deep Reinforcement Learning Method
    Tang, Jie
    Song, Jingru
    Ou, Junhui
    Luo, Jingci
    Zhang, Xiuyin
    Wong, Kai-Kit
    IEEE ACCESS, 2020, 8 : 9124 - 9132
  • [49] Cost optimization of UAV-MEC network calculation offloading: A multi-agent reinforcement learning method
    Xue, Jianbin
    Wu, Qingqing
    Zhang, Haijun
    AD HOC NETWORKS, 2022, 136
  • [50] Multi-ship collaborative collision avoidance strategy based on multi-agent deep reinforcement learning
    Huang R.
    Luo L.
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2024, 30 (06): : 1972 - 1988