Deep Reinforcement Learning Based Joint Partial Computation Offloading and Resource Allocation in Mobility-Aware MEC System

被引:0
作者
Wang, Luyao [1 ,2 ]
Zhang, Guanglin [1 ,2 ]
机构
[1] Donghua Univ, Coll Informat Sci & Technol, Shanghai 201620, Peoples R China
[2] Minist Educ, Engn Res Ctr Digitized Text & Apparel Technol, Shanghai 201620, Peoples R China
基金
中国国家自然科学基金;
关键词
mobile edge computing; energy harvesting; device-mobility; partial computation offloading; resource allocation; deep reinforcement learning; EDGE; EFFICIENCY; NETWORKS; DEVICES;
D O I
暂无
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Mobile edge computing (MEC) emerges as a paradigm to free mobile devices (MDs) from increasingly dense computing workloads in 6G networks. The quality of computing experience can be greatly improved by offloading computing tasks from MDs to MEC servers. Renewable energy harvested by energy harvesting equipments (EHQs) is considered as a promising power supply for users to process and offload tasks. In this paper, we apply the uniform mobility model of MDs to derive a more realistic wireless channel model in a multi-user MEC system with batteries as EHQs to harvest and storage energy. We investigate an optimization problem of the weighted sum of delay cost and energy cost of MDs in the MEC system. We propose an effective joint partial computation offloading and resource allocation (CORA) algorithm which is based on deep reinforcement learning (DRL) to obtain the optimal scheduling without prior knowledge of task arrival, renewable energy arrival as well as channel condition. The simulation results verify the efficiency of the proposed algorithm, which undoubtedly minimizes the cost of MDs compared with other benchmarks.
引用
收藏
页码:85 / 99
页数:15
相关论文
共 41 条
[1]   Timely Updates in Energy Harvesting Two-Hop Networks: Offline and Online Policies [J].
Arafa, Ahmed ;
Ulukus, Sennur .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2019, 18 (08) :4017-4030
[2]   Asymmetric Modulation Design for Wireless Information and Power Transfer With Nonlinear Energy Harvesting [J].
Bayguzina, Ekaterina ;
Clerckx, Bruno .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2019, 18 (12) :5529-5541
[3]   Revisiting Computation Partitioning in Future 5G-Based Edge Computing Environments [J].
Cao, Jin ;
Yang, Lei ;
Cao, Jiannong .
IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (02) :2427-2438
[4]   A Vision of C-V2X: Technologies, Field Testing, and Challenges With Chinese Development [J].
Chen, Shanzhi ;
Hu, Jinling ;
Shi, Yan ;
Zhao, Li ;
Li, Wen .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (05) :3872-3881
[5]   Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing [J].
Chen, Xu ;
Jiao, Lei ;
Li, Wenzhong ;
Fu, Xiaoming .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2016, 24 (05) :2827-2840
[6]   TOFFEE: Task Offloading and Frequency Scaling for Energy Efficiency of Mobile Devices in Mobile Edge Computing [J].
Chen, Ying ;
Zhang, Ning ;
Zhang, Yongchao ;
Chen, Xin ;
Wu, Wen ;
Shen, Xuemin .
IEEE TRANSACTIONS ON CLOUD COMPUTING, 2021, 9 (04) :1634-1644
[7]   Energy Efficient Dynamic Offloading in Mobile Edge Computing for Internet of Things [J].
Chen, Ying ;
Zhang, Ning ;
Zhang, Yongchao ;
Chen, Xin ;
Wu, Wen ;
Shen, Xuemin .
IEEE TRANSACTIONS ON CLOUD COMPUTING, 2021, 9 (03) :1050-1060
[8]   Parallel Offloading in Green and Sustainable Mobile Edge Computing for Delay-Constrained IoT System [J].
Deng, Yiqin ;
Chen, Zhigang ;
Yao, Xin ;
Hassan, Shahzad ;
Ibrahim, Ali. M. A. .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (12) :12202-12214
[9]   A Code-Oriented Partitioning Computation Offloading Strategy for Multiple Users and Multiple Mobile Edge Computing Servers [J].
Ding, Yan ;
Liu, Chubo ;
Zhou, Xu ;
Liu, Zhao ;
Tang, Zhuo .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (07) :4800-4810
[10]   Delay Analysis of Social Group Multicast-Aided Content Dissemination in Cellular System [J].
Hu, Jie ;
Yang, Lie-Liang ;
Hanzo, Lajos .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2016, 64 (04) :1660-1673