Deep Reinforcement Learning Based Resource Allocation in Multi-UAV-Aided MEC Networks

被引:76
作者
Chen, Jingxuan [1 ,2 ]
Cao, Xianbin [1 ,2 ,3 ]
Yang, Peng [1 ,2 ,3 ]
Xiao, Meng [1 ,2 ]
Ren, Siqiao [1 ,2 ]
Zhao, Zhongliang [1 ,2 ,3 ]
Wu, Dapeng Oliver [4 ]
机构
[1] Beihang Univ, Sch Elect & Informat Engn, Beijing 100191, Peoples R China
[2] Beihang Univ, Key Lab Adv Technol Near Space Informat Syst, Minist Ind & Informat Technol China, Beijing 100191, Peoples R China
[3] Peng Cheng Lab, Dept Math & Theories, Shenzhen 518055, Guangdong, Peoples R China
[4] City Univ Hong Kong, Dept Comp Sci, Kowloon, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Energy consumption; Resource management; Autonomous aerial vehicles; Task analysis; Optimization; Trajectory; Energy efficiency; MEC; UAV; resource allocation; movement control; DRL; EDGE; OPTIMIZATION;
D O I
10.1109/TCOMM.2022.3226193
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Resource allocation for mobile edge computing (MEC) in unmanned aerial vehicle (UAV) networks has been a popular research issue. Different from existing works, this paper considers a multi-UAV-aided uplink communication scenario and investigates a resource allocation problem of minimizing the total system latency and the energy consumption, subject to constraints on transmit power of mobile users (MUs), system latency caused by transmission and computation. The problem is confirmed to be a challenging time-series mixed-integer non-convex programming problem, and we propose a joint UAV Movement control, MU Association and MU Power control (UMAP) algorithm to solve it effectively, where three sub-problems are optimized iteratively. Specifically, UAV movement and MU association are optimized utilizing deep reinforcement learning (DRL) to decrease the energy consumption and system latency. Next, a closed-form solution of the MU transmit power is derived. Finally, simulation results show that the UMAP algorithm can significantly decrease the system latency and energy consumption and increase the coverage rate compared with benchmark algorithms.
引用
收藏
页码:296 / 309
页数:14
相关论文
共 42 条
[1]   Computation Rate Maximization for Wireless Powered Mobile-Edge Computing With Binary Computation Offloading [J].
Bi, Suzhi ;
Zhang, Ying Jun .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (06) :4177-4190
[2]   Efficient 3-D Placement of an Aerial Base Station in Next Generation Cellular Networks [J].
Bor-Yaliniz, R. Irem ;
El-Keyi, Amr ;
Yanikomeroglu, Haiti .
2016 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2016,
[3]   Joint MU-MIMO Precoding and Resource Allocation for Mobile-Edge Computing [J].
Ding, Changfeng ;
Wang, Jun-Bo ;
Zhang, Hua ;
Lin, Min ;
Wang, Jiangzhou .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (03) :1639-1654
[4]   Joint Resources and Workflow Scheduling in UAV-Enabled Wirelessly-Powered MEC for IoT Systems [J].
Du, Yao ;
Yang, Kun ;
Wang, Kezhi ;
Zhang, Guopeng ;
Zhao, Yizhe ;
Chen, Dongwei .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (10) :10187-10200
[5]   Multi-UAV-Assisted MEC System: Joint Association and Resource Management Framework [J].
Ei, Nway Nway ;
Kang, Seok Won ;
Alsenwi, Madyan ;
Tun, Yan Kyaw ;
Hong, Choong Seon .
35TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2021), 2021, :213-218
[6]   Design of a 5G Network Slice Extension With MEC UAVs Managed With Reinforcement Learning [J].
Faraci, Giuseppe ;
Grasso, Christian ;
Schembra, Giovanni .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2020, 38 (10) :2356-2371
[7]   Single and Multi-Agent Deep Reinforcement Learning for AI-Enabled Wireless Networks: A Tutorial [J].
Feriani, Amal ;
Hossain, Ekram .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2021, 23 (02) :1226-1252
[8]   UAV-Assisted Relaying and Edge Computing: Scheduling and Trajectory Optimization [J].
Hu, Xiaoyan ;
Wong, Kai-Kit ;
Yang, Kun ;
Zheng, Zhongbin .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2019, 18 (10) :4738-4752
[9]   Deep Reinforcement Learning for Online Computation Offloading in Wireless Powered Mobile-Edge Computing Networks [J].
Huang, Liang ;
Bi, Suzhi ;
Zhang, Ying-Jun Angela .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2020, 19 (11) :2581-2593
[10]   Fine-Grained Task Offloading for UAV via MEC-Enabled Networks [J].
Huang, Shuyang ;
Li, Linpei ;
Pan, Qi ;
Zheng, Wei ;
Lu, Zhaoming .
2019 IEEE 30TH INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (IEEE PIMRC WORKSHOPS), 2019,