Joint Task Offloading and Resource Allocation via Proximal Policy Optimization for Mobile Edge Computing Network

被引:4
作者
An, Lingling [1 ]
Wang, Zhuo [1 ]
Yue, Jiahao [2 ]
Ma, Xiaoliang [3 ]
机构
[1] Xidian Univ, Sch Comp Sci & Technol, Xian, Peoples R China
[2] Xidian Univ, Guangzhou Inst Technol, Guangzhou, Peoples R China
[3] China Telecom Corp Ltd, Guangzhou Branch, Guangzhou, Peoples R China
来源
2021 INTERNATIONAL CONFERENCE ON NETWORKING AND NETWORK APPLICATIONS, NANA | 2021年
基金
中国国家自然科学基金;
关键词
mobile edge computing; task offloading; resource allocation; proximal policy optimization; ENERGY-EFFICIENT;
D O I
10.1109/NaNA53684.2021.00087
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Various innovative applications of emerging mobile Internet have exploded in recent years, which brings huge challenges to terminal devices with limited CPU computing ability and battery capacity. The realization of high-performance computing offloading based on different optimization indicators (e.g., task delay and energy consumption) is currently a research hotspot in the field of mobile edge computing (MEC). This paper proposes a joint task offloading and resource allocation algorithm via proximal policy optimization for multiple terminal users and multiple MEC servers. The proposed algorithm designs the local task buffer queues for terminal users and edge task buffer queues for MEC servers, which allows the tasks to be executed on buffer queues in a first-in-first-out way, leading to a precise calculation of waiting delays of tasks. Moreover, it formulates the objective optimization problem as the Markov decision process and employs the proximal policy optimization algorithm to minimize the weighted sum of the task delay and energy consumption. Simulation results show the proposed algorithm outperforms the baselines with better performance.
引用
收藏
页码:466 / 471
页数:6
相关论文
共 15 条
[1]   Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSA [J].
Alfakih, Taha ;
Hassan, Mohammad Mehedi ;
Gumaei, Abdu ;
Savaglio, Claudio ;
Fortino, Giancarlo .
IEEE ACCESS, 2020, 8 :54074-54084
[2]   Computation Rate Maximization for Wireless Powered Mobile-Edge Computing With Binary Computation Offloading [J].
Bi, Suzhi ;
Zhang, Ying Jun .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (06) :4177-4190
[3]   Computation Peer Offloading for Energy-Constrained Mobile Edge Computing in Small-Cell Networks [J].
Chen, Lixing ;
Zhou, Sheng ;
Xu, Jie .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2018, 26 (04) :1619-1632
[4]   MEC-Assisted Immersive VR Video Streaming Over Terahertz Wireless Networks: A Deep Reinforcement Learning Approach [J].
Du, Jianbo ;
Yu, F. Richard ;
Lu, Guangyue ;
Wang, Junxuan ;
Jiang, Jing ;
Chu, Xiaoli .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (10) :9517-9529
[5]   Computation Offloading and Resource Allocation in Mixed Fog/Cloud Computing Systems With Min-Max Fairness Guarantee [J].
Du, Jianbo ;
Zhao, Liqiang ;
Feng, Jie ;
Chu, Xiaoli .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2018, 66 (04) :1594-1608
[6]  
Farouk NM, 2017, 2017 ADVANCES IN WIRELESS AND OPTICAL COMMUNICATIONS (RTUWO), P102, DOI 10.1109/RTUWO.2017.8228514
[7]   Energy-Efficient and Delay-Guaranteed Workload Allocation in IoT-Edge-Cloud Computing Systems [J].
Guo, Mian ;
Li, Lei ;
Guan, Quansheng .
IEEE ACCESS, 2019, 7 :78685-78697
[8]   Energy-Efficient Cooperative Resource Allocation in Wireless Powered Mobile Edge Computing [J].
Ji, Luyue ;
Guo, Songtao .
IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (03) :4744-4754
[9]   Dependency-Aware Computation Offloading in Mobile Edge Computing: A Reinforcement Learning Approach [J].
Pan, Shengli ;
Zhang, Zhiyong ;
Zhang, Zongwang ;
Zeng, Deze .
IEEE ACCESS, 2019, 7 :134742-134753
[10]  
Schulman J, 2017, Arxiv, DOI [arXiv:1707.06347, DOI 10.48550/ARXIV.1707.06347]