Research on Task Offloading Based on Deep Reinforcement Learning in Mobile Edge Computing

被引:0
作者
Lu H. [1 ]
Gu C. [1 ]
Luo F. [1 ]
Ding W. [1 ]
Yang T. [1 ]
Zheng S. [1 ]
机构
[1] School of Information Science and Engineering, East China University of Science and Technology, Shanghai
来源
Gu, Chunhua (chgu@ecust.edu.cn) | 1600年 / Science Press卷 / 57期
基金
中国国家自然科学基金;
关键词
Deep reinforcement learning; Hindsight experience replay (HER); Long short-term memory (LSTM) network; Mobile edge computing; Task offloading;
D O I
10.7544/issn1000-1239.2020.20190291
中图分类号
学科分类号
摘要
In the mobile edge computing, the local device can offload tasks to the server near the edge of the network for data storage and computation processing, thereby reducing the delay and power consumption of the service. Therefore, the task offloading decision has great research value. This paper first constructs an offloading model with multi-service nodes and multi-dependencies within mobile tasks in large-scale heterogeneous mobile edge computing. Then, an improved deep reinforcement learning algorithm is proposed to optimize the task offloading strategy by combining the actual application scenarios of mobile edge computing. Finally, the advantages and disadvantages of each offloading strategy are analyzed by comprehensively comparing the energy consumption, cost, load balancing, delay, network usage and average execution time. The simulation results show that the improved HERDRQN algorithm based on long short-term memory (LSTM) network and HER (hindsight experience replay) has good effects on energy consumption, cost, load balancing and delay. In addition, this paper uses various algorithm strategies to offload a certain number of applications, and compares the number distribution of heterogeneous devices under different CPU utilizations to verify the relationship between the offloading strategy and each evaluation index, so as to prove that the strategy generated by HERDRQN algorithm is scientific and effective in solving the task offloading problem. © 2020, Science Press. All right reserved.
引用
收藏
页码:1539 / 1554
页数:15
相关论文
共 27 条
[1]  
Zhao Ziming, Liu Fang, Cai Zhiping, Et al., Edge Computing: Platforms, Applications and Callenges, Journal of Computer Research and Development, 55, 2, pp. 327-337, (2018)
[2]  
Skarlat O, Nardelli M, Schulte S, Et al., Optimized IoT service placement in the fog, Service Oriented Computing and Applications, 11, 4, pp. 427-443, (2017)
[3]  
Zi Zishu, Xie Renchao, Sun Li, Et al., A survey of mobile edge computing, Telecommunication Science, 34, 1, pp. 87-101, (2018)
[4]  
Liu Liqing, Chang Zheng, Guo Xijuan, Et al., Multiobjective optimization for computation offloading in fog computing, IEEE Internet of Things Journal, 5, 1, pp. 283-294, (2017)
[5]  
Chen M, Liang Ben, Dong Min, Joint offloading decision and resource allocation for multi-user multi-task mobile cloud, Proc of 2016 IEEE Int Conf on Communications, (2016)
[6]  
Munoz O, Pascual-Iserte A, Vidal J., Optimization of radio and computational resources for energy efficiency in latency-constrained application offloading, IEEE Transactions on Vehicular Technology, 64, 10, pp. 4738-4755, (2014)
[7]  
Ren Jinke, Yu Guanding, Cai Yunlong, Et al., Latency optimization for resource allocation in mobile-edge computation offloading, IEEE Transactions on Wireless Communications, 17, 8, pp. 5506-5519, (2018)
[8]  
You Changsheng, Huang Kaibin, Chae H, Et al., Energy-efficient resource allocation for mobile-edge computation offloading, IEEE Transactions on Wireless Communications, 16, 3, pp. 1397-1411, (2016)
[9]  
He Yin, Zhang Zheng, Yu F R, Et al., Deep reinforcement learning-based optimization for cache-enabled opportunistic interference alignment wireless networks, IEEE Transactions on Vehicular Technology, 66, 11, pp. 10433-10445, (2017)
[10]  
Messaoudi F, Ksentini A, Bertin P., On using edge computing for computation offloading in mobile network, Proc of 2017 IEEE Global Communications Conf, (2017)