Multi-UAV Assisted Offloading Optimization: A Game Combined Reinforcement Learning Approach

被引:6
作者
Gao, Ang [1 ]
Wang, Qi [1 ]
Chen, Kaiyue [1 ]
Liang, Wei [1 ]
机构
[1] Northwestern Polytech Univ, Sch Elect & Informat, Xian 710072, Peoples R China
关键词
Games; Task analysis; Relays; Energy consumption; Delays; Convergence; Trajectory optimization; Offloading; DRL; potential game; DDPG; NETWORKS; DESIGN;
D O I
10.1109/LCOMM.2021.3078469
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Although unmanned aerial vehicles (UAVs) have attracted much attention by providing aerial relays to massive ground users (GUs) for tasks offloading, there still exist several issues, such as the unbalance of tasks size and trajectory optimization related to energy efficiency and obstacles avoidance. The letter models the multi-UAV assisted offloading system as two separate problems optimized by a potential game combined reinforcement learning algorithm, i.e., potential game for service assignment, and deep deterministic policy gradient (DDPG) for trajectory planning. The former largely reduces the convergence time, and the latter can search the best action in a continuous domain. The numerical results show that the proposed approach has great advantages in minimizing offloading delay, enhancing energy efficiency and avoiding obstacles.
引用
收藏
页码:2629 / 2633
页数:5
相关论文
共 50 条
  • [1] Game Combined Multi-Agent Reinforcement Learning Approach for UAV Assisted Offloading
    Gao, Ang
    Wang, Qi
    Liang, Wei
    Ding, Zhiguo
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (12) : 12888 - 12901
  • [2] Joint Power and QoE Optimization Scheme for Multi-UAV Assisted Offloading in Mobile Computing
    Wang, Qi
    Gao, Ang
    Hu, Yansu
    IEEE ACCESS, 2021, 9 : 21206 - 21217
  • [3] A multi-UAV assisted task offloading and path optimization for mobile edge computing via multi-agent deep reinforcement learning
    Ju, Tao
    Li, Linjuan
    Liu, Shuai
    Zhang, Yu
    JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2024, 229
  • [4] Joint Task Offloading and Resource Allocation in Multi-UAV Multi-Server Systems: An Attention-Based Deep Reinforcement Learning Approach
    Wu, Guohua
    Liu, Zelin
    Fan, Mingfeng
    Wu, Keyu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (08) : 11964 - 11978
  • [5] JOINT TRAJECTORY AND ENERGY EFFICIENCY OPTIMIZATION FOR MULTI-UAV ASSISTED OFFLOADING
    Gao, Ang
    Shao, Zhenyuan
    Hu, Yansu
    Liang, Wei
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 508 - 511
  • [6] Multi-UAV Assisted Network Coverage Optimization for Rescue Operations using Reinforcement Learning
    Oubbati, Omar Sami
    Badis, Hakim
    Rachedi, Abderrezak
    Lakas, Abderrahmane
    Lorenz, Pascal
    2023 IEEE 20TH CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE, CCNC, 2023,
  • [7] Task Offloading and Trajectory Optimization for Secure Communications in Dynamic User Multi-UAV MEC Systems
    Zhang, Yuhao
    Kuang, Zhufang
    Feng, Yanyan
    Hou, Fen
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (12) : 14427 - 14440
  • [8] Joint Computation Offloading, Channel Access and Scheduling Optimization in UAV Swarms: A Game-Theoretic Learning Approach
    Chen, Runfeng
    Cui, Li
    Wang, Meng
    Zhang, Yuli
    Yao, Kailing
    Yang, Yang
    Yao, Changhua
    IEEE OPEN JOURNAL OF THE COMPUTER SOCIETY, 2021, 2 : 308 - 320
  • [9] Computation Offloading and Trajectory Planning of Multi-UAV-Enabled MEC: A Knowledge-Assisted Multiagent Reinforcement Learning Approach
    Li, Xulong
    Qin, Yunhui
    Huo, Jiahao
    Wei, Huangfu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (05) : 7077 - 7088
  • [10] Deep Reinforcement Learning-Based Dual-Timescale Service Caching and Computation Offloading for Multi-UAV Assisted MEC Systems
    Lin, Na
    Han, Xiao
    Hawbani, Ammar
    Sun, Yunhe
    Guan, Yunchong
    Zhao, Liang
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2025, 22 (01): : 605 - 617