Mobility Aware Channel Allocation for 5G Vehicular Networks using Multi-Agent Reinforcement Learning

被引:6
|
作者
Kumar, Anitha Saravana [1 ]
Zhao, Lian [1 ]
Fernando, Xavier [1 ]
机构
[1] Ryerson Univ, Dept Elect Comp & Biomed Engn, Toronto, ON, Canada
来源
IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021) | 2021年
关键词
Vehicular Networks; Multi-Agent Reinforcement Learning; Teammate Learning; Channel allocation; RESOURCE-ALLOCATION;
D O I
10.1109/ICC42927.2021.9500625
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Reinforcement learning is a machine learning technique that focuses on exploring an uncharted territory exploiting of current knowledge. This paper proposes a Mobility Aware Channel Allocation (MACA) algorithm for SG Vehicular Networks using a combination of Multi-Agent Reinforcement Learning (MARL) and Semi-Markov Decision Process (SMDP). In this work, we use multiple autonomous agents operating in a common environment to address the sequential decision-making problem to optimize the long-term rewards. In MACA, first we predict the mobility of vehicles using Teammate-Learning model as it allows the vehicles to cooperate and collaborate with each other without prior coordination. Secondly, during SMDP resource allocation phase, MARL inputs are applied to the Action Selection model for each vehicle based on their priorities. This is done at Road-Side Units (RSUs). Through numerical results and evaluations, we verify that the proposed method demonstrates efficient channel allocation and high packet delivery ratio as compared in the scenario of vehicles with multiple (high, medium, and low) priorities to existing conventional SMDP and Greedy algorithms.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] DISTRIBUTED RESOURCE ALLOCATION IN 5G NETWORKS WITH MULTI-AGENT REINFORCEMENT LEARNING
    Menard, Jon
    Al-Habashna, Ala'a
    Wainer, Gabriel
    Boudreau, Gary
    PROCEEDINGS OF THE 2022 ANNUAL MODELING AND SIMULATION CONFERENCE (ANNSIM'22), 2022, : 802 - 813
  • [2] Multi-Agent Deep Reinforcement Learning-Empowered Channel Allocation in Vehicular Networks
    Kumar, Anitha Saravana
    Zhao, Lian
    Fernando, Xavier
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (02) : 1726 - 1736
  • [3] Multi-Agent Reinforcement Learning for Slicing Resource Allocation in Vehicular Networks
    Cui, Yaping
    Shi, Hongji
    Wang, Ruyan
    He, Peng
    Wu, Dapeng
    Huang, Xinyun
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (02) : 2005 - 2016
  • [4] Enhanced Resource Allocation in Vehicular Networks via Multi-Agent Reinforcement Learning
    Zhang, Yu
    Wang, Shufei
    Hua, Minyu
    Zhang, Yibin
    Wang, Yu
    Tomoaki, Ohtsuki
    Sari, Hikmet
    Gui, Guan
    2024 IEEE 99TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2024-SPRING, 2024,
  • [5] Non-cooperative multi-agent deep reinforcement learning for channel resource allocation in vehicular networks
    Zhang, Fuxin
    Yao, Sihan
    Liu, Wei
    Qi, Liang
    COMPUTER NETWORKS, 2025, 257
  • [6] Spectrum Sharing in Vehicular Networks Based on Multi-Agent Reinforcement Learning
    Liang, Le
    Ye, Hao
    Li, Geoffrey Ye
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2019, 37 (10) : 2282 - 2292
  • [7] Multi-Agent Reinforcement Learning Aided Resources Allocation Method in Vehicular Networks
    Ji, Yuxin
    Zhang, Xixi
    Wang, Yu
    Gacanin, Haris
    Sari, Hikmet
    Adachi, Fumiyuki
    Gui, Guan
    2022 IEEE 96TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-FALL), 2022,
  • [8] Mobility-Aware Resource Allocation for mmWave IAB Networks: A Multi-Agent Reinforcement Learning Approach
    Zhang, Bibo
    Filippini, Ilario
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2024, 32 (04) : 3559 - 3574
  • [9] Multi-Agent Reinforcement Learning for Spectrum Sharing in Vehicular Networks
    Liang, Le
    Ye, Hao
    Li, Geoffrey Ye
    2019 IEEE 20TH INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (SPAWC 2019), 2019,
  • [10] Enabling Reinforcement Learning for Network Slice Management in Multi-Agent 5G Networks
    Tufeanu, Larisa-Mihaela
    Vochin, Marius-Constantin
    Paraschiv, Constantin-Laurentiu
    Li, Frank Y.
    2023 IEEE 9TH WORLD FORUM ON INTERNET OF THINGS, WF-IOT, 2023,