Deep reinforcement learning-based computation offloading for 5G vehicle-aware multi-access edge computing network

被引:39
|
作者
Wu, Ziying [1 ]
Yan, Danfeng [1 ]
机构
[1] Beijing Univ Posts & Telecommun, State Key Lab Network & Switching Technol, Beijing 100876, Peoples R China
基金
国家重点研发计划;
关键词
Task analysis; Servers; Delays; Resource management; 5G mobile communication; Optimization; Energy consumption; multi-access edge computing; computation offloading; 5G; vehicle-aware; deep reinforcement learning; deep q-network; RESOURCE-ALLOCATION; BANDWIDTH ALLOCATION; MOBILE;
D O I
10.23919/JCC.2021.11.003
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Multi-access Edge Computing (MEC) is one of the key technologies of the future 5G network. By deploying edge computing centers at the edge of wireless access network, the computation tasks can be offloaded to edge servers rather than the remote cloud server to meet the requirements of 5G low-latency and high-reliability application scenarios. Meanwhile, with the development of IOV (Internet of Vehicles) technology, various delay-sensitive and compute-intensive in-vehicle applications continue to appear. Compared with traditional Internet business, these computation tasks have higher processing priority and lower delay requirements. In this paper, we design a 5G-based vehicle-aware Multi-access Edge Computing network (VAMECN) and propose a joint optimization problem of minimizing total system cost. In view of the problem, a deep reinforcement learning-based joint computation offloading and task migration optimization (JCOTM) algorithm is proposed, considering the influences of multiple factors such as concurrent multiple computation tasks, system computing resources distribution, and network communication bandwidth. And, the mixed integer nonlinear programming problem is described as a Markov Decision Process. Experiments show that our proposed algorithm can effectively reduce task processing delay and equipment energy consumption, optimize computing offloading and resource allocation schemes, and improve system resource utilization, compared with other computing offloading policies.
引用
收藏
页码:26 / 41
页数:16
相关论文
共 50 条
  • [21] Optimization for computational offloading in multi-access edge computing: A deep reinforcement learning scheme
    Wang, Jian
    Ke, Hongchang
    Liu, Xuejie
    Wang, Hui
    COMPUTER NETWORKS, 2022, 204
  • [22] Deep Reinforcement Learning-Based Computation Offloading for Mobile Edge Computing in 6G
    Sun, Haifeng
    Wang, Jiawei
    Yong, Dongping
    Qin, Mingwei
    Zhang, Ning
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (04) : 7482 - 7493
  • [23] Computation Offloading Based on Game Theory in Multi-access Edge Computing for 6G Network
    Gao, Lixue
    Chen, Xin
    Yin, Bo
    Wu, Bilian
    2022 14TH INTERNATIONAL CONFERENCE ON COMMUNICATION SOFTWARE AND NETWORKS (ICCSN 2022), 2022, : 63 - 68
  • [24] Collaborative Computation Offloading for Multi-access Edge Computing
    Yu, Shuai
    Langar, Rami
    2019 IFIP/IEEE SYMPOSIUM ON INTEGRATED NETWORK AND SERVICE MANAGEMENT (IM), 2019, : 689 - 694
  • [25] Graph convolutional network-based reinforcement learning for tasks offloading in multi-access edge computing
    Leng, Lixiong
    Li, Jingchen
    Shi, Haobin
    Zhu, Yi'an
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (19) : 29163 - 29175
  • [26] Deadline-Aware Task Offloading With Partially-Observable Deep Reinforcement Learning for Multi-Access Edge Computing
    Huang, Hui
    Ye, Qiang
    Zhou, Yitong
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (06): : 3870 - 3885
  • [27] Computation Offloading with Privacy-Preserving in Multi-Access Edge Computing: A Multi-Agent Deep Reinforcement Learning Approach
    Dai, Xiang
    Luo, Zhongqiang
    Zhang, Wei
    ELECTRONICS, 2024, 13 (13)
  • [28] The Advantage of Computation Offloading in Multi-Access Edge Computing
    Singh, Raghubir
    Armour, Simon
    Khan, Aftab
    Sooriyabandara, Mahesh
    Oikonomou, George
    2019 FOURTH INTERNATIONAL CONFERENCE ON FOG AND MOBILE EDGE COMPUTING (FMEC), 2019, : 289 - 294
  • [29] Graph convolutional network-based reinforcement learning for tasks offloading in multi-access edge computing
    Lixiong Leng
    Jingchen Li
    Haobin Shi
    Yi’an Zhu
    Multimedia Tools and Applications, 2021, 80 : 29163 - 29175
  • [30] DNN inference offloading for object detection in 5G multi-access edge computing
    Kim, Geun-Yong
    Kim, Ryangsoo
    Kim, Sungchang
    Nam, Ki-Dong
    Rha, Sung-Uk
    Yoon, Jung-Hyun
    12TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC 2021): BEYOND THE PANDEMIC ERA WITH ICT CONVERGENCE INNOVATION, 2021, : 389 - 392