Deep Reinforcement Learning based Computation Offloading and Resource Allocation for MEC

被引:2
作者
Li, Ji [1 ]
Gao, Hui [1 ]
Lv, Tiejun [1 ]
Lu, Yueming [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Informat & Commun Engn, Minist Educ, Key Lab Trustworthy Distributed Comp & Serv, Beijing 100876, Peoples R China
来源
2018 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC) | 2018年
关键词
MOBILE; INTERNET; RADIO;
D O I
10.1109/wcnc.2018.8377343
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Mobile edge computing (MEC) has the potential to enable computation-intensive applications in 5G networks. MEC can extend the computational capacity at the edge of wireless networks by migrating the computation-intensive tasks to the MEC server. In this paper, we consider a multi-user MEC system, where multiple user equipments (UEs) can perform computation offloading via wireless channels to an MEC server. We formulate the sum cost of delay and energy consumptions for all UEs as our optimization objective. In order to minimize the sum cost of the considered MEC system, we jointly optimize the offloading decision and computational resource allocation. However, it is challenging to obtain an optimal policy in such a dynamic system. Besides immediate reward, Reinforcement Learning (RL) also takes a long-term goal into consideration, which is very important to a time-variant dynamic systems, such as our considered multi-user wireless MEC system. To this end, we propose RL-based optimization framework to tackle the resource allocation in wireless MEC. Specifically, the Q-learning based and Deep Reinforcement Learning (DRL) based schemes are proposed, respectively. Simulation results show that the proposed scheme achieves significant reduction on the sum cost compared to other baselines.
引用
收藏
页数:6
相关论文
共 17 条
[1]   Communicating While Computing [Distributed mobile cloud computing over 5G heterogeneous networks] [J].
Barbarossa, Sergio ;
Sardellitti, Stefania ;
Di Lorenzo, Paolo .
IEEE SIGNAL PROCESSING MAGAZINE, 2014, 31 (06) :45-55
[2]   Optimal Radio Resource Allocation for Mobile Task Offloading in Cellular Networks [J].
Cao, Yang ;
Jiang, Tao ;
Wang, Chonggang .
IEEE NETWORK, 2014, 28 (05) :68-73
[3]   Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing [J].
Chen, Xu ;
Jiao, Lei ;
Li, Wenzhong ;
Fu, Xiaoming .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2016, 24 (05) :2827-2840
[4]  
Hong S.H., 2016, Int. J. Environ. Res. Public Health, V13, P1, DOI DOI 10.1109/SAHCN.2016.7733009
[6]   CLOUD COMPUTING FOR MOBILE USERS: CAN OFFLOADING COMPUTATION SAVE ENERGY? [J].
Kumar, Karthik ;
Lu, Yung-Hsiang .
COMPUTER, 2010, 43 (04) :51-56
[7]   Joint Admission Control and Resource Allocation in Edge Computing for Internet of Things [J].
Li, Shichao ;
Zhang, Ning ;
Lin, Siyu ;
Kong, Linghe ;
Katangur, Ajay ;
Khan, Muhammad Khurram ;
Ni, Minming ;
Zhu, Gang .
IEEE NETWORK, 2018, 32 (01) :72-79
[8]  
Liu J, 2016, IEEE INT SYMP INFO, P1451, DOI 10.1109/ISIT.2016.7541539
[9]   Mobile Edge Computing: A Survey on Architecture and Computation Offloading [J].
Mach, Pavel ;
Becvar, Zdenek .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2017, 19 (03) :1628-1656
[10]   Recent Advances in Cloud Radio Access Networks: System Architectures, Key Techniques, and Open Issues [J].
Peng, Mugen ;
Sun, Yaohua ;
Li, Xuelong ;
Mao, Zhendong ;
Wang, Chonggang .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2016, 18 (03) :2282-2308