Multi-UAV Assisted Offloading Optimization: A Game Combined Reinforcement Learning Approach

被引:6
|
作者
Gao, Ang [1 ]
Wang, Qi [1 ]
Chen, Kaiyue [1 ]
Liang, Wei [1 ]
机构
[1] Northwestern Polytech Univ, Sch Elect & Informat, Xian 710072, Peoples R China
关键词
Games; Task analysis; Relays; Energy consumption; Delays; Convergence; Trajectory optimization; Offloading; DRL; potential game; DDPG; NETWORKS; DESIGN;
D O I
10.1109/LCOMM.2021.3078469
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Although unmanned aerial vehicles (UAVs) have attracted much attention by providing aerial relays to massive ground users (GUs) for tasks offloading, there still exist several issues, such as the unbalance of tasks size and trajectory optimization related to energy efficiency and obstacles avoidance. The letter models the multi-UAV assisted offloading system as two separate problems optimized by a potential game combined reinforcement learning algorithm, i.e., potential game for service assignment, and deep deterministic policy gradient (DDPG) for trajectory planning. The former largely reduces the convergence time, and the latter can search the best action in a continuous domain. The numerical results show that the proposed approach has great advantages in minimizing offloading delay, enhancing energy efficiency and avoiding obstacles.
引用
收藏
页码:2629 / 2633
页数:5
相关论文
共 50 条
  • [21] Multi-UAV Hierarchical Intelligent Traffic Offloading Network Optimization Based on Deep Federated Learning
    Li, Fengqi
    Zhang, Kaiyang
    Wang, Jiaheng
    Li, Yudong
    Xu, Fengqiang
    Wang, Yanjuan
    Tong, Ning
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (12): : 21312 - 21324
  • [22] Joint Task Offloading and Resource Allocation in Multi-UAV Multi-Server Systems: An Attention-Based Deep Reinforcement Learning Approach
    Wu, Guohua
    Liu, Zelin
    Fan, Mingfeng
    Wu, Keyu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (08) : 11964 - 11978
  • [23] Game of Drones: Multi-UAV Pursuit-Evasion Game With Online Motion Planning by Deep Reinforcement Learning
    Zhang, Ruilong
    Zong, Qun
    Zhang, Xiuyun
    Dou, Liqian
    Tian, Bailing
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (10) : 7900 - 7909
  • [24] An Offloading Optimization Scheme for Multi-UAV Aided Network in Mobile Computing
    Gao, Ang
    Wang, Qi
    Hu, Yansu
    Duan, Weijun
    2020 16TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC, 2020, : 1468 - 1473
  • [25] Multi-UAV Delay Optimization in Edge Caching Networks: A Mean Field Game Approach
    Xue, Kaiyuan
    Li, Lixin
    Yang, Fucheng
    Zhang, Huisheng
    Li, Xu
    Han, Zhu
    2019 28TH WIRELESS AND OPTICAL COMMUNICATIONS CONFERENCE (WOCC), 2019, : 68 - 72
  • [26] Collaborative Computation Offloading and Resource Allocation in Multi-UAV-Assisted IoT Networks: A Deep Reinforcement Learning Approach
    Seid, Abegaz Mohammed
    Boateng, Gordon Owusu
    Anokye, Stephen
    Kwantwi, Thomas
    Sun, Guolin
    Liu, Guisong
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (15) : 12203 - 12218
  • [27] Multi-UAV-assisted computation offloading in DT-based networks: A distributed deep reinforcement learning approach
    Shi, Junling
    Li, Chunyu
    Guan, Yunchong
    Cong, Peiyu
    Li, Jie
    COMPUTER COMMUNICATIONS, 2023, 210 : 217 - 228
  • [28] Adaptive Data Collection and Offloading in Multi-UAV-Assisted Maritime IoT Systems: A Deep Reinforcement Learning Approach
    Liang, Ziyi
    Dai, Yanpeng
    Lyu, Ling
    Lin, Bin
    REMOTE SENSING, 2023, 15 (02)
  • [29] Deep Reinforcement Learning Approach for Joint Trajectory Design in Multi-UAV IoT Networks
    Xu, Shu
    Zhan, Xiangyu
    Li, Chunguo
    Wang, Dongming
    Yang, Luxi
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (03) : 3389 - 3394
  • [30] Multi-agent Computation Offloading in UAV Assisted MEC via Deep Reinforcement Learning
    He, Hang
    Ren, Tao
    Qiu, Yuan
    Hu, Zheyuan
    Li, Yanqi
    SMART COMPUTING AND COMMUNICATION, 2022, 13202 : 416 - 426