Deep Reinforcement Learning for Task Offloading and Power Allocation in UAV-Assisted MEC System

被引:1
作者
Zhao, Nan [1 ]
Ren, Fan [1 ]
Du, Wei [1 ]
Ye, Zhiyang [1 ]
机构
[1] Hubei Univ Technol, Wuhan, Hubei, Peoples R China
关键词
Deep Reinforcement Learning; Mobile Edge Computing; Power Allocation; Task Offloading; UAV; RESOURCE-ALLOCATION;
D O I
10.4018/IJMCMC.289163
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Mobile edge computing (MEC) can provide computing services for mobile users (MUs) by offloading computing tasks to edge clouds through wireless access networks. Unmanned aerial vehicles (UAVs) are deployed as supplementary edge clouds to provide effective MEC services for MUs with poor wireless communication condition. In this paper, a joint task offloading and power allocation (TOPA) optimization problem is investigated in UAV-assisted MEC system. Since the joint TOPA problem has a strong non-convex characteristic, a method based on deep reinforcement learning is proposed. Specifically, the joint TOPA problem is modeled as Markov decision process. Then, considering the large state space and continuous action space, a twin delayed deep deterministic policy gradient algorithm is proposed. Simulation results show that the proposed scheme has lower smoothing training cost than other optimization methods.
引用
收藏
页码:32 / 51
页数:20
相关论文
共 25 条
[1]   Dynamic Pricing for Differentiated PEV Charging Services Using Deep Reinforcement Learning [J].
Abdalrahman, Ahmed ;
Zhuang, Weihua .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (02) :1415-1427
[2]  
Ahmed N., 2005, ACM SIGMOBILE MOBILE, V9, P4
[3]  
Chen JY, 2019, IEEE INT C INTELL TR, P2765, DOI [10.1109/ITSC.2019.8917306, 10.1109/itsc.2019.8917306]
[4]   Vehicle Assisted Computing Offloading for Unmanned Aerial Vehicles in Smart City [J].
Dai, Minghui ;
Su, Zhou ;
Xu, Qichao ;
Zhang, Ning .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (03) :1932-1944
[5]   Joint computation offloading and task caching for multi-user and multi-task MEC systems: reinforcement learning-based algorithms [J].
Elgendy, Ibrahim A. ;
Zhang, Wei-Zhe ;
He, Hui ;
Gupta, Brij B. ;
Abd El-Latif, Ahmed A. .
WIRELESS NETWORKS, 2021, 27 (03) :2023-2038
[6]  
Fujimoto S, 2018, PR MACH LEARN RES, V80
[7]   Joint Task Offloading, Resource Allocation, and Security Assurance for Mobile Edge Computing-Enabled UAV-Assisted VANETs [J].
He, Yixin ;
Zhai, Daosen ;
Huang, Fanghui ;
Wang, Dawei ;
Tang, Xiao ;
Zhang, Ruonan .
REMOTE SENSING, 2021, 13 (08)
[8]   Energy Consumption Minimization in UAV-Assisted Mobile-Edge Computing Systems: Joint Resource Allocation and Trajectory Design [J].
Ji, Jiequ ;
Zhu, Kun ;
Yi, Changyan ;
Niyato, Dusit .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (10) :8570-8584
[9]   Energy-Efficient UAV-Assisted Mobile Edge Computing: Resource Allocation and Trajectory Optimization [J].
Li, Mushu ;
Cheng, Nan ;
Gao, Jie ;
Wang, Yinlu ;
Zhao, Lian ;
Shen, Xuemin .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (03) :3424-3438
[10]  
Lillicrap T. P., 2015, arXiv