Deep reinforcement learning-based computation offloading for 5G vehicle-aware multi-access edge computing network

被引:39
|
作者
Wu, Ziying [1 ]
Yan, Danfeng [1 ]
机构
[1] Beijing Univ Posts & Telecommun, State Key Lab Network & Switching Technol, Beijing 100876, Peoples R China
基金
国家重点研发计划;
关键词
Task analysis; Servers; Delays; Resource management; 5G mobile communication; Optimization; Energy consumption; multi-access edge computing; computation offloading; 5G; vehicle-aware; deep reinforcement learning; deep q-network; RESOURCE-ALLOCATION; BANDWIDTH ALLOCATION; MOBILE;
D O I
10.23919/JCC.2021.11.003
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Multi-access Edge Computing (MEC) is one of the key technologies of the future 5G network. By deploying edge computing centers at the edge of wireless access network, the computation tasks can be offloaded to edge servers rather than the remote cloud server to meet the requirements of 5G low-latency and high-reliability application scenarios. Meanwhile, with the development of IOV (Internet of Vehicles) technology, various delay-sensitive and compute-intensive in-vehicle applications continue to appear. Compared with traditional Internet business, these computation tasks have higher processing priority and lower delay requirements. In this paper, we design a 5G-based vehicle-aware Multi-access Edge Computing network (VAMECN) and propose a joint optimization problem of minimizing total system cost. In view of the problem, a deep reinforcement learning-based joint computation offloading and task migration optimization (JCOTM) algorithm is proposed, considering the influences of multiple factors such as concurrent multiple computation tasks, system computing resources distribution, and network communication bandwidth. And, the mixed integer nonlinear programming problem is described as a Markov Decision Process. Experiments show that our proposed algorithm can effectively reduce task processing delay and equipment energy consumption, optimize computing offloading and resource allocation schemes, and improve system resource utilization, compared with other computing offloading policies.
引用
收藏
页码:26 / 41
页数:16
相关论文
共 50 条
  • [1] Deep Reinforcement Learning-Based Computation Offloading for 5G Vehicle-Aware Multi-Access Edge Computing Network
    Ziying Wu
    Danfeng Yan
    ChinaCommunications, 2021, 18 (11) : 26 - 41
  • [2] Graph Attention Network Reinforcement Learning Based Computation Offloading in Multi-Access Edge Computing
    Liu, Yuxuan
    Xia, Geming
    Chen, Jian
    Zhang, Danlei
    2023 IEEE 47TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE, COMPSAC, 2023, : 966 - 969
  • [3] Efficient Computation Offloading for Multi-Access Edge Computing in 5G HetNets
    Guo, Hongzhi
    Liu, Jiajia
    Zhang, Jie
    2018 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2018,
  • [4] Machine learning-based computation offloading in multi-access edge computing: A survey
    Choudhury, Alok
    Ghose, Manojit
    Islam, Akhirul
    Yogita
    JOURNAL OF SYSTEMS ARCHITECTURE, 2024, 148
  • [5] Computation Offloading in Multi-Access Edge Computing Using a Deep Sequential Model Based on Reinforcement Learning
    Wang, Jin
    Hu, Jia
    Min, Geyong
    Zhan, Wenhan
    Ni, Qiang
    Georgalas, Nektarios
    IEEE COMMUNICATIONS MAGAZINE, 2019, 57 (05) : 64 - 69
  • [6] Online Computation Offloading in NOMA-Based Multi-Access Edge Computing: A Deep Reinforcement Learning Approach
    Nduwayezu, Maurice
    Quoc-Viet Pham
    Hwang, Won-Joo
    IEEE ACCESS, 2020, 8 : 99098 - 99109
  • [7] Learning-based Privacy-Preserving Computation Offloading in Multi-Access Edge Computing
    You, Feiran
    Yuan, Xin
    Ni, Wei
    Jamalipour, Abbas
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 922 - 927
  • [8] Task Computation Offloading for Multi-Access Edge Computing via Attention Communication Deep Reinforcement Learning
    Li, Kexin
    Wang, Xingwei
    He, Qiang
    Yang, Mingzhou
    Huang, Min
    Dustdar, Schahram
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (04) : 2985 - 2999
  • [9] Secured Computation Offloading in Multi-Access Mobile Edge Computing Networks through Deep Reinforcement Learning
    Abdullah R.
    Yaacob N.A.
    Salameh A.A.
    Zaki N.A.M.
    Bahardin N.F.
    International Journal of Interactive Mobile Technologies, 2024, 18 (11) : 80 - 91
  • [10] Deep Reinforcement Learning for Dependent Task Offloading in Multi-Access Edge Computing
    Ye, Hengzhou
    Li, Jiaming
    Lu, Qiu
    IEEE ACCESS, 2024, 12 : 166281 - 166297