Multiagent Deep Deterministic Policy Gradient-Based Computation Offloading and Resource Allocation for ISAC-Aided 6G V2X Networks

被引:4
|
作者
Hu, Bintao [1 ]
Zhang, Wenzhang [1 ]
Gao, Yuan [2 ]
Du, Jianbo [3 ]
Chu, Xiaoli [4 ]
机构
[1] Xian Jiaotong Liverpool Univ, Sch Internet Things, Suzhou 215123, Peoples R China
[2] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
[3] Xian Univ Posts & Telecommun, Sch Commun & Informat Engn, Xian 710121, Peoples R China
[4] Univ Sheffield, Dept Elect & Elect Engn, Sheffield S1 3JD, England
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 20期
关键词
Resource management; Task analysis; Optimization; Vehicle-to-everything; Delays; Communication networks; Servers; Computation offloading; deep reinforcement learning (DRL); edge intelligence; integrated sensing and communications (ISACs); resource allocation; vehicle-to-everything (V2X) communications;
D O I
10.1109/JIOT.2024.3432728
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Vehicular communications in future sixth-generation (6G) networks are expected to leverage integrated sensing and communications (ISACs) and mobile edge computing (MEC) techniques. However, the rapid proliferation of vehicle user equipment (V-UE) and the diversity of ISAC-aided and MEC-empowered vehicular communication and computation services demand a more intelligent and efficient resource allocation framework for the next-generation vehicular networks. To address this issue, we propose a comprehensive ISAC-aided vehicle-to-everything (V2X) MEC framework, where the V-UEs can offload their tasks to the edge server collocated at the roadside unit (RSU). We aim to minimize the long-term average total service delay of all the V-UEs by jointly optimizing the offloading decisions of all the V-UEs, the computation resource allocation at the ISAC-aided RSU, the transmission power, and the allocation of resource blocks for all the V-UEs, where the total service delay of a V-UE includes the task processing delay and the transmission delay if the V-UE offloads its task to the RSU. To solve the formulated mixed integer nonlinear programming problem, we design a multiagent deep deterministic policy gradient (MADDPG)-based offloading optimization and resource allocation algorithm (MADDPG-O2RA2). Simulation results demonstrate that our proposed algorithm outperforms the benchmarks in terms of convergence and the long-term average delay among all the V-UEs.
引用
收藏
页码:33890 / 33902
页数:13
相关论文
共 50 条
  • [1] Energy-Efficient Joint Computation Offloading and Resource Allocation Strategy for ISAC-Aided 6G V2X Networks
    Liu, Qian
    Luo, Rui
    Liang, Hairong
    Liu, Qilie
    IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2023, 7 (01): : 413 - 423
  • [2] Deep Deterministic Policy Gradient-Based Algorithm for Computation Offloading in IoV
    Li, Haofei
    Chen, Chen
    Shan, Hangguan
    Li, Pu
    Chang, Yoong Choon
    Song, Houbing
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (03) : 2522 - 2533
  • [3] Twin delayed deep deterministic policy gradient-based intelligent computation offloading for IoT
    Siguang Chen
    Bei Tang
    Kun Wang
    Digital Communications and Networks, 2023, 9 (04) : 836 - 845
  • [4] Twin delayed deep deterministic policy gradient-based intelligent computation offloading for IoT
    Chen, Siguang
    Tang, Bei
    Wang, Kun
    DIGITAL COMMUNICATIONS AND NETWORKS, 2023, 9 (04) : 836 - 845
  • [5] Algorithm for Resource Allocation and Computing Offloading in 6G Networks: Deep Reinforcement Learning-based
    Saeed, Mamoon M.
    Saeed, Rashid A.
    Ali, Elmustafa Sayed
    Mokhtar, Rania A.
    Khalifa, Othman O.
    9TH INTERNATIONAL CONFERENCE ON MECHATRONICS ENGINEERING, ICOM 2024, 2024, : 188 - 193
  • [6] Deep Deterministic Policy Gradient Based Computation Offloading in Wireless-Powered MEC Networks
    Liu, Ruoqi
    Liu, Xuanlin
    Wang, Sihua
    Yin, Changchuan
    2020 IEEE GLOBECOM WORKSHOPS (GC WKSHPS), 2020,
  • [7] V2X Offloading and Resource Allocation in SDN-Assisted MEC-Based Vehicular Networks
    Zhang, Haibo
    Wang, Zixin
    Liu, Kaijian
    CHINA COMMUNICATIONS, 2020, 17 (05) : 266 - 283
  • [8] V2X Offloading and Resource Allocation in SDN-Assisted MEC-Based Vehicular Networks
    Haibo Zhang
    Zixin Wang
    Kaijian Liu
    中国通信, 2020, 17 (05) : 266 - 283
  • [9] Deep Deterministic Policy Gradient-Based Resource Allocation Considering Network Slicing and Device-to-Device Communication in Mobile Networks
    Lopes, Hudson Henrique de Souza
    Lima, Lucas Jose Ferreira
    Soares, Telma Woerle de Lima
    Vieira, Flavio Henrique Teles
    SENSORS, 2024, 24 (18)
  • [10] Federated Deep Deterministic Policy Gradient for Power Control in 6G in-X Subnetworks
    Adeogun, Ramoni
    2024 14TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, ICEENG 2024, 2024, : 199 - 201