Multi-UAV Assisted Offloading Optimization: A Game Combined Reinforcement Learning Approach

被引:8
作者
Gao, Ang [1 ]
Wang, Qi [1 ]
Chen, Kaiyue [1 ]
Liang, Wei [1 ]
机构
[1] Northwestern Polytech Univ, Sch Elect & Informat, Xian 710072, Peoples R China
关键词
Games; Task analysis; Relays; Energy consumption; Delays; Convergence; Trajectory optimization; Offloading; DRL; potential game; DDPG; NETWORKS; DESIGN;
D O I
10.1109/LCOMM.2021.3078469
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Although unmanned aerial vehicles (UAVs) have attracted much attention by providing aerial relays to massive ground users (GUs) for tasks offloading, there still exist several issues, such as the unbalance of tasks size and trajectory optimization related to energy efficiency and obstacles avoidance. The letter models the multi-UAV assisted offloading system as two separate problems optimized by a potential game combined reinforcement learning algorithm, i.e., potential game for service assignment, and deep deterministic policy gradient (DDPG) for trajectory planning. The former largely reduces the convergence time, and the latter can search the best action in a continuous domain. The numerical results show that the proposed approach has great advantages in minimizing offloading delay, enhancing energy efficiency and avoiding obstacles.
引用
收藏
页码:2629 / 2633
页数:5
相关论文
共 10 条
[1]   Decentralized Computation Offloading Game for Mobile Cloud Computing [J].
Chen, Xu .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2015, 26 (04) :974-983
[2]   UAV Trajectory Optimization for Data Offloading at the Edge of Multiple Cells [J].
Cheng, Fen ;
Zhang, Shun ;
Li, Zan ;
Chen, Yunfei ;
Zhao, Nan ;
Yu, F. Richard ;
Leung, Victor C. M. .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2018, 67 (07) :6732-6736
[3]   A Green Strategic Activity Scheduling for UAV Networks: A Sub-Modular Game Perspective [J].
Koulali, Sara ;
Sabir, Essaid ;
Taleb, Tarik ;
Azizi, Mostafa .
IEEE COMMUNICATIONS MAGAZINE, 2016, 54 (05) :58-64
[4]  
Lillicrap T. P., 2015, PREPRINT
[5]   Energy-Efficient UAV Control for Effective and Fair Communication Coverage: A Deep Reinforcement Learning Approach [J].
Liu, Chi Harold ;
Chen, Zheyu ;
Tang, Jian ;
Xu, Jie ;
Piao, Chengzhe .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2018, 36 (09) :2059-2070
[6]   Trajectory Design and Power Control for Multi-UAV Assisted Wireless Networks: A Machine Learning Approach [J].
Liu, Xiao ;
Liu, Yuanwei ;
Chen, Yue ;
Hanzo, Lajos .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (08) :7957-7969
[7]   Multi-Agent Deep Reinforcement Learning-Based Trajectory Planning for Multi-UAV Assisted Mobile Edge Computing [J].
Wang, Liang ;
Wang, Kezhi ;
Pan, Cunhua ;
Xu, Wei ;
Aslam, Nauman ;
Hanzo, Lajos .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2021, 7 (01) :73-84
[8]   Joint Trajectory and Communication Design for Multi-UAV Enabled Wireless Networks [J].
Wu, Qingqing ;
Zeng, Yong ;
Zhang, Rui .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (03) :2109-2121
[9]  
Yang G., 2019, INT J NEUROSCI, P1, DOI DOI 10.1080/00207454.2019.1663189
[10]   Energy-Efficient Data Collection in UAV Enabled Wireless Sensor Network [J].
Zhan, Cheng ;
Zeng, Yong ;
Zhang, Rui .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2018, 7 (03) :328-331