An Offloading Algorithm based on Markov Decision Process in Mobile Edge Computing System

被引:0
作者
Yao B. [1 ]
Wu B. [2 ]
Wu S. [3 ]
Ji Y. [4 ]
Chen D. [2 ]
Liu L. [2 ]
机构
[1] School of computer science and technology, Nanjing Tech University, Nanjing
[2] Nanjing Inrich Technology Co., Ltd., Nanjing
[3] National Mobile Communications Research Laboratory, Southeast University, Nanjing
[4] Zhengrong Intelligent Technology (Nanjing) Co., Ltd., Nanjing
来源
International Journal of Circuits, Systems and Signal Processing | 2022年 / 16卷
关键词
Mobile Edge Computing (MEC); Offloading; Value iteration algorithm; —Markov Decision Process (MDP);
D O I
10.46300/9106.2022.16.15
中图分类号
学科分类号
摘要
—In this paper, an offloading algorithm based on Markov Decision Process (MDP) is proposed to solve the multi-objective offloading decision problem in Mobile Edge Computing (MEC) system. The feature of the algorithm is that MDP is used to make offloading decision. The number of tasks in the task queue, the number of accessible edge clouds and Signal-Noise-Ratio (SNR) of the wireless channel are taken into account in the state space of the MDP model. The offloading delay and energy consumption are considered to define the value function of the MDP model, i.e. the objective function. To maximize the value function, Value Iteration Algorithm is used to obtain the optimal offloading policy. According to the policy, tasks of mobile terminals (MTs) are offloaded to the edge cloud or central cloud, or executed locally. The simulation results show that the proposed algorithm can effectively reduce the offloading delay and energy consumption. © 2022, North Atlantic University Union NAUN. All rights reserved.
引用
收藏
页码:115 / 121
页数:6
相关论文
共 12 条
[1]  
Khan A. U. R., Othman M., Madani S., Khan S.U., A Survey of Mobile Cloud Computing Application Models, IEEE Communications Surveys & Tutorials, 16, 1, pp. 393-413, (2014)
[2]  
Mach P., Becvar Z., Mobile Edge Computing: A Survey on Architecture and Computation Offloading, IEEE Communications Surveys & Tutorials, 19, 3, pp. 1628-1656, (2017)
[3]  
Xu X., Liu J., Tao X., Mobile Edge Computing Enhanced Adaptive Bitrate Video Delivery with Joint Cache and Radio Resource Allocation, IEEE Access, 5, 99, pp. 16406-16415, (2017)
[4]  
Chen X., Jiao L., Li W., Fu X., Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing, IEEE/ACM Transactions on Networking, 24, 5, pp. 2795-2808, (2016)
[5]  
Munoz O., Pascual-Iserte A., Vidal J., Joint Allocation of Radio and Computational Resources in Wireless Application Offloading, 2013 Future Network & Mobile Summit, pp. 1-10, (2013)
[6]  
Sardellitti S., Scutari G., Barbarossa S., Joint Optimization of Radio and Computational Resources for Multicell Mobile-Edge Computing, IEEE Transactions on Signal and Information Processing over Networks, 1, 2, pp. 89-103, (2015)
[7]  
Truong-Huu T., Tham C. K., Niyato D., To offload or to Wait: An Opportunistic Offloading Algorithm for Parallel Tasks in a Mobile Cloud, 2014 IEEE 6th International Conference on Cloud Computing Technology and Science, pp. 182-189, (2014)
[8]  
Huang D., Wang P., Niyato D., A Dynamic Offloading Algorithm for Mobile Computing, IEEE Transactions on Wireless Communications, 11, 6, pp. 1991-1995, (2012)
[9]  
Guo S., Xiao B., Yang Y., Yang Y., Energy-efficient Dynamic Offloading and Resource Scheduling in Mobile Cloud Computing, IEEE INFOCOM 2016, The 35th Annual IEEE International Conference on Computer Communications, 4, pp. 1-9, (2016)
[10]  
Zhang Y., Niyato D., Wang P., Offloading in Mobile Cloudlet Systems with Intermittent Connectivity, IEEE Transactions on Mobile Computing, 14, 12, pp. 2516-2529, (2015)