Deep Reinforcement Learning Based Resource Allocation in Multi-UAV-Aided MEC Networks

被引:76
作者
Chen, Jingxuan [1 ,2 ]
Cao, Xianbin [1 ,2 ,3 ]
Yang, Peng [1 ,2 ,3 ]
Xiao, Meng [1 ,2 ]
Ren, Siqiao [1 ,2 ]
Zhao, Zhongliang [1 ,2 ,3 ]
Wu, Dapeng Oliver [4 ]
机构
[1] Beihang Univ, Sch Elect & Informat Engn, Beijing 100191, Peoples R China
[2] Beihang Univ, Key Lab Adv Technol Near Space Informat Syst, Minist Ind & Informat Technol China, Beijing 100191, Peoples R China
[3] Peng Cheng Lab, Dept Math & Theories, Shenzhen 518055, Guangdong, Peoples R China
[4] City Univ Hong Kong, Dept Comp Sci, Kowloon, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Energy consumption; Resource management; Autonomous aerial vehicles; Task analysis; Optimization; Trajectory; Energy efficiency; MEC; UAV; resource allocation; movement control; DRL; EDGE; OPTIMIZATION;
D O I
10.1109/TCOMM.2022.3226193
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Resource allocation for mobile edge computing (MEC) in unmanned aerial vehicle (UAV) networks has been a popular research issue. Different from existing works, this paper considers a multi-UAV-aided uplink communication scenario and investigates a resource allocation problem of minimizing the total system latency and the energy consumption, subject to constraints on transmit power of mobile users (MUs), system latency caused by transmission and computation. The problem is confirmed to be a challenging time-series mixed-integer non-convex programming problem, and we propose a joint UAV Movement control, MU Association and MU Power control (UMAP) algorithm to solve it effectively, where three sub-problems are optimized iteratively. Specifically, UAV movement and MU association are optimized utilizing deep reinforcement learning (DRL) to decrease the energy consumption and system latency. Next, a closed-form solution of the MU transmit power is derived. Finally, simulation results show that the UMAP algorithm can significantly decrease the system latency and energy consumption and increase the coverage rate compared with benchmark algorithms.
引用
收藏
页码:296 / 309
页数:14
相关论文
共 42 条
[31]   Dynamic Resource Scheduling in Mobile Edge Cloud with Cloud Radio Access Network [J].
Wang, Xinhou ;
Wang, Kezhi ;
Wu, Song ;
Di, Sheng ;
Jin, Hai ;
Yang, Kun ;
Ou, Shumao .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2018, 29 (11) :2429-2445
[32]   Energy-Efficient Resource Allocation for Secure NOMA-Enabled Mobile Edge Computing Networks [J].
Wu, Wei ;
Zhou, Fuhui ;
Hu, Rose Qingyang ;
Wang, Baoyun .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (01) :493-505
[33]   Energy-Efficient Resource Allocation in a Multi-UAV-Aided NOMA Network [J].
Xi, Xing ;
Cao, Xianbin ;
Yang, Peng ;
Chen, Jingxuan ;
Wu, Dapeng .
2021 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2021,
[34]   Multi-UAV-Enabled Load-Balance Mobile-Edge Computing for IoT Networks [J].
Yang, Lei ;
Yao, Haipeng ;
Wang, Jingjing ;
Jiang, Chunxiao ;
Benslimane, Abderrahim ;
Liu, Yunjie .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (08) :6898-6908
[35]   Three-Dimensional Continuous Movement Control of Drone Cells for Energy-Efficient Communication Coverage [J].
Yang, Peng ;
Cao, Xianbin ;
Xi, Xing ;
Du, Wenbo ;
Xiao, Zhenyu ;
Wu, Dapeng .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (07) :6535-6546
[36]   Real-Time Profiling of Fine-Grained Air Quality Index Distribution Using UAV Sensing [J].
Yang, Yuzhe ;
Zheng, Zijie ;
Bian, Kaigui ;
Song, Lingyang ;
Han, Zhu .
IEEE INTERNET OF THINGS JOURNAL, 2018, 5 (01) :186-198
[37]   Computation Offloading With Data Caching Enhancement for Mobile Edge Computing [J].
Yu, Shuai ;
Langar, Rami ;
Fu, Xiaoming ;
Wang, Li ;
Han, Zhu .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2018, 67 (11) :11098-11112
[38]   Joint Task Offloading and Resource Allocation in UAV-Enabled Mobile Edge Computing [J].
Yu, Zhe ;
Gong, Yanmin ;
Gong, Shimin ;
Guo, Yuanxiong .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (04) :3147-3159
[39]   3D Deployment of Multiple UAV-Mounted Base Stations for UAV Communications [J].
Zhang, Chen ;
Zhang, Leyi ;
Zhu, Lipeng ;
Zhang, Tao ;
Xiao, Zhenyu ;
Xia, Xiang-Gen .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (04) :2473-2488
[40]   Joint Trajectory and Precoding Optimization for UAV-Assisted NOMA Networks [J].
Zhao, Nan ;
Pang, Xiaowei ;
Li, Zan ;
Chen, Yunfei ;
Li, Feng ;
Ding, Zhiguo ;
Alouini, Mohamed-Slim .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2019, 67 (05) :3723-3735