Multi-UAV Assisted Offloading Optimization: A Game Combined Reinforcement Learning Approach

被引:6
|
作者
Gao, Ang [1 ]
Wang, Qi [1 ]
Chen, Kaiyue [1 ]
Liang, Wei [1 ]
机构
[1] Northwestern Polytech Univ, Sch Elect & Informat, Xian 710072, Peoples R China
关键词
Games; Task analysis; Relays; Energy consumption; Delays; Convergence; Trajectory optimization; Offloading; DRL; potential game; DDPG; NETWORKS; DESIGN;
D O I
10.1109/LCOMM.2021.3078469
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Although unmanned aerial vehicles (UAVs) have attracted much attention by providing aerial relays to massive ground users (GUs) for tasks offloading, there still exist several issues, such as the unbalance of tasks size and trajectory optimization related to energy efficiency and obstacles avoidance. The letter models the multi-UAV assisted offloading system as two separate problems optimized by a potential game combined reinforcement learning algorithm, i.e., potential game for service assignment, and deep deterministic policy gradient (DDPG) for trajectory planning. The former largely reduces the convergence time, and the latter can search the best action in a continuous domain. The numerical results show that the proposed approach has great advantages in minimizing offloading delay, enhancing energy efficiency and avoiding obstacles.
引用
收藏
页码:2629 / 2633
页数:5
相关论文
共 50 条
  • [31] Multi-agent Computation Offloading in UAV Assisted MEC via Deep Reinforcement Learning
    He, Hang
    Ren, Tao
    Qiu, Yuan
    Hu, Zheyuan
    Li, Yanqi
    SMART COMPUTING AND COMMUNICATION, 2022, 13202 : 416 - 426
  • [32] Deep Reinforcement Learning for Multi-Hop Offloading in UAV-Assisted Edge Computing
    Nguyen Tien Hoa
    Do Van Dai
    Le Hoang Lan
    Nguyen Cong Luong
    Duc Van Le
    Niyato, Dusit
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (12) : 16917 - 16922
  • [33] Multi-UAV Dynamic Wireless Networking With Deep Reinforcement Learning
    Wang, Qiang
    Zhang, Wenqi
    Liu, Yuanwei
    Liu, Ying
    IEEE COMMUNICATIONS LETTERS, 2019, 23 (12) : 2243 - 2246
  • [34] Multi-UAV Conflict Resolution with Graph Convolutional Reinforcement Learning
    Isufaj, Ralvi
    Omeri, Marsel
    Piera, Miquel Angel
    APPLIED SCIENCES-BASEL, 2022, 12 (02):
  • [35] Multi-agent reinforcement learning based transmission scheme for IRS-assisted multi-UAV systems
    Mei, Yumo
    Liu, Chen
    Song, Yunchao
    Wang, Ge
    Liang, Huibin
    IET COMMUNICATIONS, 2023, 17 (17) : 2019 - 2029
  • [36] Energy optimization and age of information enhancement in multi-UAV networks using deep reinforcement learning
    Kim, Jeena
    Park, Seunghyun
    Park, Hyunhee
    ELECTRONICS LETTERS, 2024, 60 (20)
  • [37] Computation Offloading and Trajectory Planning of Multi-UAV-Enabled MEC: A Knowledge-Assisted Multiagent Reinforcement Learning Approach
    Li, Xulong
    Qin, Yunhui
    Huo, Jiahao
    Wei, Huangfu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (05) : 7077 - 7088
  • [38] Joint Optimization of Multi-UAV Target Assignment and Path Planning Based on Multi-Agent Reinforcement Learning
    Qie, Han
    Shi, Dianxi
    Shen, Tianlong
    Xu, Xinhai
    Li, Yuan
    Wang, Liujing
    IEEE ACCESS, 2019, 7 : 146264 - 146272
  • [39] Resource Allocation in High Dynamic Multi-UAV Networks for Coverage Continuity: A Reinforcement Learning Approach
    Zhou, Chengyi
    Li, Jiandong
    Liu, Junyu
    Sheng, Min
    Zhao, Nan
    2023 INTERNATIONAL CONFERENCE ON FUTURE COMMUNICATIONS AND NETWORKS, FCN, 2023,
  • [40] Deep Reinforcement Learning for UAV-Assisted Spectrum Sharing: A Minority Game Approach
    Ding, Xinyu
    Zhang, Jie
    Wang, Zhe
    Wang, Xuehe
    2023 IEEE INTERNATIONAL CONFERENCES ON INTERNET OF THINGS, ITHINGS IEEE GREEN COMPUTING AND COMMUNICATIONS, GREENCOM IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING, CPSCOM IEEE SMART DATA, SMARTDATA AND IEEE CONGRESS ON CYBERMATICS,CYBERMATICS, 2024, : 44 - 50