Mobility Aware Channel Allocation for 5G Vehicular Networks using Multi-Agent Reinforcement Learning

被引:6
|
作者
Kumar, Anitha Saravana [1 ]
Zhao, Lian [1 ]
Fernando, Xavier [1 ]
机构
[1] Ryerson Univ, Dept Elect Comp & Biomed Engn, Toronto, ON, Canada
关键词
Vehicular Networks; Multi-Agent Reinforcement Learning; Teammate Learning; Channel allocation; RESOURCE-ALLOCATION;
D O I
10.1109/ICC42927.2021.9500625
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Reinforcement learning is a machine learning technique that focuses on exploring an uncharted territory exploiting of current knowledge. This paper proposes a Mobility Aware Channel Allocation (MACA) algorithm for SG Vehicular Networks using a combination of Multi-Agent Reinforcement Learning (MARL) and Semi-Markov Decision Process (SMDP). In this work, we use multiple autonomous agents operating in a common environment to address the sequential decision-making problem to optimize the long-term rewards. In MACA, first we predict the mobility of vehicles using Teammate-Learning model as it allows the vehicles to cooperate and collaborate with each other without prior coordination. Secondly, during SMDP resource allocation phase, MARL inputs are applied to the Action Selection model for each vehicle based on their priorities. This is done at Road-Side Units (RSUs). Through numerical results and evaluations, we verify that the proposed method demonstrates efficient channel allocation and high packet delivery ratio as compared in the scenario of vehicles with multiple (high, medium, and low) priorities to existing conventional SMDP and Greedy algorithms.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] DISTRIBUTED RESOURCE ALLOCATION IN 5G NETWORKS WITH MULTI-AGENT REINFORCEMENT LEARNING
    Menard, Jon
    Al-Habashna, Ala'a
    Wainer, Gabriel
    Boudreau, Gary
    PROCEEDINGS OF THE 2022 ANNUAL MODELING AND SIMULATION CONFERENCE (ANNSIM'22), 2022, : 802 - 813
  • [2] Multi-Agent Deep Reinforcement Learning-Empowered Channel Allocation in Vehicular Networks
    Kumar, Anitha Saravana
    Zhao, Lian
    Fernando, Xavier
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (02) : 1726 - 1736
  • [3] Multi-Agent Reinforcement Learning for Slicing Resource Allocation in Vehicular Networks
    Cui, Yaping
    Shi, Hongji
    Wang, Ruyan
    He, Peng
    Wu, Dapeng
    Huang, Xinyun
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (02) : 2005 - 2016
  • [4] Non-cooperative multi-agent deep reinforcement learning for channel resource allocation in vehicular networks
    Zhang, Fuxin
    Yao, Sihan
    Liu, Wei
    Qi, Liang
    COMPUTER NETWORKS, 2025, 257
  • [5] Multi-Agent Reinforcement Learning Aided Resources Allocation Method in Vehicular Networks
    Ji, Yuxin
    Zhang, Xixi
    Wang, Yu
    Gacanin, Haris
    Sari, Hikmet
    Adachi, Fumiyuki
    Gui, Guan
    2022 IEEE 96TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-FALL), 2022,
  • [6] Enhanced Resource Allocation in Vehicular Networks via Multi-Agent Reinforcement Learning
    Zhang, Yu
    Wang, Shufei
    Hua, Minyu
    Zhang, Yibin
    Wang, Yu
    Tomoaki, Ohtsuki
    Sari, Hikmet
    Gui, Guan
    2024 IEEE 99TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2024-SPRING, 2024,
  • [7] Mobility-Aware Resource Allocation for mmWave IAB Networks: A Multi-Agent Reinforcement Learning Approach
    Zhang, Bibo
    Filippini, Ilario
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2024, 32 (04) : 3559 - 3574
  • [8] Freshness aware vehicular crowdsensing with multi-agent reinforcement learning
    Ma, Junhao
    Yu, Yantao
    Liu, Guojin
    Huang, Tiancong
    COMPUTER NETWORKS, 2025, 257
  • [9] Cooperative perception in Vehicular Networks using Multi-Agent Reinforcement Learning
    Abdel-Aziz, Mohamed K.
    Samarakoon, Sumudu
    Perfecto, Cristina
    Bennis, Mehdi
    2020 54TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2020, : 408 - 412
  • [10] Enabling Reinforcement Learning for Network Slice Management in Multi-Agent 5G Networks
    Tufeanu, Larisa-Mihaela
    Vochin, Marius-Constantin
    Paraschiv, Constantin-Laurentiu
    Li, Frank Y.
    2023 IEEE 9TH WORLD FORUM ON INTERNET OF THINGS, WF-IOT, 2023,