Deep Reinforcement Learning Based Resource Allocation in Multi-UAV-Aided MEC Networks

被引:76
作者
Chen, Jingxuan [1 ,2 ]
Cao, Xianbin [1 ,2 ,3 ]
Yang, Peng [1 ,2 ,3 ]
Xiao, Meng [1 ,2 ]
Ren, Siqiao [1 ,2 ]
Zhao, Zhongliang [1 ,2 ,3 ]
Wu, Dapeng Oliver [4 ]
机构
[1] Beihang Univ, Sch Elect & Informat Engn, Beijing 100191, Peoples R China
[2] Beihang Univ, Key Lab Adv Technol Near Space Informat Syst, Minist Ind & Informat Technol China, Beijing 100191, Peoples R China
[3] Peng Cheng Lab, Dept Math & Theories, Shenzhen 518055, Guangdong, Peoples R China
[4] City Univ Hong Kong, Dept Comp Sci, Kowloon, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Energy consumption; Resource management; Autonomous aerial vehicles; Task analysis; Optimization; Trajectory; Energy efficiency; MEC; UAV; resource allocation; movement control; DRL; EDGE; OPTIMIZATION;
D O I
10.1109/TCOMM.2022.3226193
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Resource allocation for mobile edge computing (MEC) in unmanned aerial vehicle (UAV) networks has been a popular research issue. Different from existing works, this paper considers a multi-UAV-aided uplink communication scenario and investigates a resource allocation problem of minimizing the total system latency and the energy consumption, subject to constraints on transmit power of mobile users (MUs), system latency caused by transmission and computation. The problem is confirmed to be a challenging time-series mixed-integer non-convex programming problem, and we propose a joint UAV Movement control, MU Association and MU Power control (UMAP) algorithm to solve it effectively, where three sub-problems are optimized iteratively. Specifically, UAV movement and MU association are optimized utilizing deep reinforcement learning (DRL) to decrease the energy consumption and system latency. Next, a closed-form solution of the MU transmit power is derived. Finally, simulation results show that the UMAP algorithm can significantly decrease the system latency and energy consumption and increase the coverage rate compared with benchmark algorithms.
引用
收藏
页码:296 / 309
页数:14
相关论文
共 42 条
[11]  
ITU, 2015, Recommendation ITU-R P.453-11
[12]   Mobile Edge Computing via a UAV-Mounted Cloudlet: Optimization of Bit Allocation and Path Planning [J].
Jeong, Seongah ;
Simeone, Osvaldo ;
Kang, Joonhyuk .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2018, 67 (03) :2049-2063
[13]   AI Driven Heterogeneous MEC System with UAV Assistance for Dynamic Environment: Challenges and Solutions [J].
Jiang, Feibo ;
Wang, Kezhi ;
Dong, Li ;
Pan, Cunhua ;
Xu, Wei ;
Yang, Kun .
IEEE NETWORK, 2021, 35 (01) :400-408
[14]   Intelligent secure mobile edge computing for beyond 5G wireless networks [J].
Lai, Shiwei ;
Zhao, Rui ;
Tang, Shunpu ;
Xia, Junjuan ;
Zhou, Fasheng ;
Fan, Liseng .
PHYSICAL COMMUNICATION, 2021, 45
[15]  
Laurila J. K., 2012, P MOB DAT CHALL WORK
[16]   Iteratively-Refined Interactive 3D Medical Image Segmentation with Multi-Agent Reinforcement Learning [J].
Liao, Xuan ;
Li, Wenhao ;
Xu, Qisen ;
Wang, Xiangfeng ;
Jin, Bo ;
Zhang, Xiaoyun ;
Wang, Yanfeng ;
Zhang, Ya .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :9391-9399
[17]   Federated Learning in Mobile Edge Networks: A Comprehensive Survey [J].
Lim, Wei Yang Bryan ;
Nguyen Cong Luong ;
Dinh Thai Hoang ;
Jiao, Yutao ;
Liang, Ying-Chang ;
Yang, Qiang ;
Niyato, Dusit ;
Miao, Chunyan .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2020, 22 (03) :2031-2063
[18]   Deep Reinforcement Learning Based Latency Minimization for Mobile Edge Computing With Virtualization in Maritime UAV Communication Network [J].
Liu, Ying ;
Yan, Junjie ;
Zhao, Xiaohui .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (04) :4225-4236
[19]   When UAV Meets IRS: Expanding Air-Ground Networks via Passive Reflection [J].
Pang, Xiaowei ;
Sheng, Min ;
Zhao, Nan ;
Tang, Jie ;
Niyato, Dusit ;
Wong, Kai-Kit .
IEEE WIRELESS COMMUNICATIONS, 2021, 28 (05) :164-170
[20]   Joint Resource Allocation and Trajectory Optimization for Multi-UAV-Assisted Multi-Access Mobile Edge Computing [J].
Qin, Xintong ;
Song, Zhengyu ;
Hao, Yuanyuan ;
Sun, Xin .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2021, 10 (07) :1400-1404