Multiagent Reinforcement Learning-Based Cooperative Multitype Task Offloading Strategy for Internet of Vehicles in B5G/6G Network

被引:17
作者
Cui, Yuya [1 ]
Li, Honghu [2 ]
Zhang, Degan [3 ]
Zhu, Aixi [1 ]
Li, Yang [1 ]
Qiang, Hao [1 ]
机构
[1] Jiangsu Vocat Coll Informat Technol, Sch Internet Things Engn, Wuxi 214153, Peoples R China
[2] Jiangsu Vocat Coll Informat Technol, Business Sch, Wuxi 214153, Peoples R China
[3] Tianjin Univ Technol, Tianjin Key Lab Intelligent Comp & Novel Software, Key Lab Comp Vis & Syst, Minist Educ, Tianjin 300384, Peoples R China
关键词
B5G/6G; computation offloading; Internet of Vehicles (IoV); multiaccess edge computing (MEC); multiagent deep reinforcement learning (DRL); RESOURCE-ALLOCATION; EDGE; IOT; CLOUD;
D O I
10.1109/JIOT.2023.3245721
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of intelligent transportation, various computation intensive and delay sensitive applications are emerging in the Internet of Vehicles (IoV). The B5G/6G (Beyond 5th generation mobile communication technology/6th generation mobile communication technology) network has the characteristics of ultralow latency and ultra many connections. The deployment of the network in boxes (NIBs) supporting B5G/6G network in the vehicle can realize the real-time communication with the edge server (ES) and offload the task to the ES. However, the current multiaccess edge computing (MEC) lacks research on cooperative processing among multiple ESs, and the efficiency of data-intensive computation tasks is still insufficient. In this article, we investigate the cooperative offloading of multitype tasks among ESs in B5G/6G networks under a dynamic environment. In order to minimize the delay of task execution, we regard cooperative offloading as a Markov decision process (MDP), and improve the convergence speed and stability of traditional soft actor-critic (SAC) algorithm by the adaptive weight sampling mechanism. Finally, an offline centralized training distributed execution framework based on improved soft actor critical (OCTDE-ISAC) is proposed to optimize the cooperative offloading strategy. The experimental results show that the proposed algorithm is better than the existing algorithm in terms of latency.
引用
收藏
页码:12248 / 12260
页数:13
相关论文
共 48 条
  • [1] Beraldi R, 2017, 2017 SECOND INTERNATIONAL CONFERENCE ON FOG AND MOBILE EDGE COMPUTING (FMEC), P94, DOI 10.1109/FMEC.2017.7946414
  • [2] Lyapunov-Guided Deep Reinforcement Learning for Stable Online Computation Offloading in Mobile-Edge Computing Networks
    Bi, Suzhi
    Huang, Liang
    Wang, Hui
    Zhang, Ying-Jun Angela
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (11) : 7519 - 7537
  • [3] Computation Rate Maximization for Wireless Powered Mobile-Edge Computing With Binary Computation Offloading
    Bi, Suzhi
    Zhang, Ying Jun
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (06) : 4177 - 4190
  • [4] Efficient Multi-Vehicle Task Offloading for Mobile Edge Computing in 6G Networks
    Chen, Ying
    Zhao, Fengjun
    Chen, Xin
    Wu, Yuan
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (05) : 4584 - 4595
  • [5] A novel offloading scheduling method for mobile application in mobile edge computing
    Cui, Yu-ya
    Zhang, De-gan
    Zhang, Ting
    Zhang, Jie
    Piao, Mingjie
    [J]. WIRELESS NETWORKS, 2022, 28 (06) : 2345 - 2363
  • [6] Novel method of mobile edge computation offloading based on evolutionary game strategy for IoT devices
    Cui, Yuya
    Zhang, Degan
    Zhang, Ting
    Chen, Lu
    Piao, Mingjie
    Zhu, Haoli
    [J]. AEU-INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATIONS, 2020, 118 (118)
  • [7] Intelligent Delay-Aware Partial Computing Task Offloading for Multiuser Industrial Internet of Things Through Edge Computing
    Deng, Xiaoheng
    Yin, Jian
    Guan, Peiyuan
    Xiong, Neal N.
    Zhang, Lan
    Mumtaz, Shahid
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (04) : 2954 - 2966
  • [8] Dependence-Aware Edge Intelligent Function Offloading for 6G-Based IoV
    Dong, Luobing
    Gao, Honghao
    Wu, Weili
    Gong, Qiwen
    Dechasa, Nemera Chala
    Liu, Yanfei
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (02) : 2265 - 2274
  • [9] Computation Offloading and Resource Allocation in Vehicular Networks Based on Dual-Side Cost Minimization
    Du, Jianbo
    Yu, F. Richard
    Chu, Xiaoli
    Feng, Jie
    Lu, Guangyue
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (02) : 1079 - 1092
  • [10] Distributional Soft Actor-Critic: Off-Policy Reinforcement Learning for Addressing Value Estimation Errors
    Duan, Jingliang
    Guan, Yang
    Li, Shengbo Eben
    Ren, Yangang
    Sun, Qi
    Cheng, Bo
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (11) : 6584 - 6598