Multiagent Deep Deterministic Policy Gradient-Based Computation Offloading and Resource Allocation for ISAC-Aided 6G V2X Networks

被引:4
作者
Hu, Bintao [1 ]
Zhang, Wenzhang [1 ]
Gao, Yuan [2 ]
Du, Jianbo [3 ]
Chu, Xiaoli [4 ]
机构
[1] Xian Jiaotong Liverpool Univ, Sch Internet Things, Suzhou 215123, Peoples R China
[2] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
[3] Xian Univ Posts & Telecommun, Sch Commun & Informat Engn, Xian 710121, Peoples R China
[4] Univ Sheffield, Dept Elect & Elect Engn, Sheffield S1 3JD, England
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 20期
关键词
Resource management; Task analysis; Optimization; Vehicle-to-everything; Delays; Communication networks; Servers; Computation offloading; deep reinforcement learning (DRL); edge intelligence; integrated sensing and communications (ISACs); resource allocation; vehicle-to-everything (V2X) communications;
D O I
10.1109/JIOT.2024.3432728
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Vehicular communications in future sixth-generation (6G) networks are expected to leverage integrated sensing and communications (ISACs) and mobile edge computing (MEC) techniques. However, the rapid proliferation of vehicle user equipment (V-UE) and the diversity of ISAC-aided and MEC-empowered vehicular communication and computation services demand a more intelligent and efficient resource allocation framework for the next-generation vehicular networks. To address this issue, we propose a comprehensive ISAC-aided vehicle-to-everything (V2X) MEC framework, where the V-UEs can offload their tasks to the edge server collocated at the roadside unit (RSU). We aim to minimize the long-term average total service delay of all the V-UEs by jointly optimizing the offloading decisions of all the V-UEs, the computation resource allocation at the ISAC-aided RSU, the transmission power, and the allocation of resource blocks for all the V-UEs, where the total service delay of a V-UE includes the task processing delay and the transmission delay if the V-UE offloads its task to the RSU. To solve the formulated mixed integer nonlinear programming problem, we design a multiagent deep deterministic policy gradient (MADDPG)-based offloading optimization and resource allocation algorithm (MADDPG-O2RA2). Simulation results demonstrate that our proposed algorithm outperforms the benchmarks in terms of convergence and the long-term average delay among all the V-UEs.
引用
收藏
页码:33890 / 33902
页数:13
相关论文
共 34 条
  • [1] [Anonymous], 2016, Rep. 36.885
  • [2] Optimized resource allocation and time partitioning for integrated communication, sensing, and edge computing network
    Cheng, Kaijun
    Fang, Xuming
    Wang, Xianbin
    [J]. COMPUTER COMMUNICATIONS, 2022, 194 : 240 - 249
  • [3] MADDPG-Based Joint Service Placement and Task Offloading in MEC Empowered Air–Ground Integrated Networks
    Du, Jianbo
    Kong, Ziwen
    Sun, Aijing
    Kang, Jiawen
    Niyato, Dusit
    Chu, Xiaoli
    Yu, F. Richard
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (06) : 10600 - 10615
  • [4] Resource Pricing and Allocation in MEC Enabled Blockchain Systems: An A3C Deep Reinforcement Learning Approach
    Du, Jianbo
    Cheng, Wenjie
    Lu, Guangyue
    Cao, Haotong
    Chu, Xiaoli
    Zhang, Zhicai
    Wang, Junxuan
    [J]. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (01): : 33 - 44
  • [5] Computation Energy Efficiency Maximization for NOMA-Based and Wireless-Powered Mobile Edge Computing With Backscatter Communication
    Du, Junhui
    Wu, Huaming
    Xu, Minxian
    Buyya, Rajkumar
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (06) : 6954 - 6970
  • [6] Efficient Anchor Point Deployment for Low Latency Connectivity in MEC-Assisted C-V2X Scenarios
    Fondo-Ferreiro, Pablo
    Gil-Castineira, Felipe
    Gonzelez-Castano, Francisco Javier
    Candal-Ventureira, David
    Rodriguez, Jonathan
    Morgado, Antonio J.
    Mumtaz, Shahid
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (12) : 16637 - 16649
  • [7] Multi-Agent Driven Resource Allocation and Interference Management for Deep Edge Networks
    Gong, Yongkang
    Yao, Haipeng
    Wang, Jingjing
    Jiang, Liang
    Yu, F. Richard
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (02) : 2018 - 2030
  • [8] Deep Reinforcement Learning-based Offloading for Latency Minimization in 3-tier V2X Networks
    Hieu Dinh
    Nang Hung Nguyen
    Trung Thanh Nguyen
    Thanh Hung Nguyen
    Nguyen, Truong Thao
    Phi Le Nguyen
    [J]. 2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 1803 - 1808
  • [9] Hou P., IEEE Trans. Intell. Veh.
  • [10] Joint computation offloading and resource allocation based on deep reinforcement learning in C-V2X edge computing
    Hou, Peng
    Jiang, Xiaohan
    Lu, Zhihui
    Li, Bo
    Wang, Zongshan
    [J]. APPLIED INTELLIGENCE, 2023, 53 (19) : 22446 - 22466