Mobility Aware Channel Allocation for 5G Vehicular Networks using Multi-Agent Reinforcement Learning

被引:6
|
作者
Kumar, Anitha Saravana [1 ]
Zhao, Lian [1 ]
Fernando, Xavier [1 ]
机构
[1] Ryerson Univ, Dept Elect Comp & Biomed Engn, Toronto, ON, Canada
关键词
Vehicular Networks; Multi-Agent Reinforcement Learning; Teammate Learning; Channel allocation; RESOURCE-ALLOCATION;
D O I
10.1109/ICC42927.2021.9500625
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Reinforcement learning is a machine learning technique that focuses on exploring an uncharted territory exploiting of current knowledge. This paper proposes a Mobility Aware Channel Allocation (MACA) algorithm for SG Vehicular Networks using a combination of Multi-Agent Reinforcement Learning (MARL) and Semi-Markov Decision Process (SMDP). In this work, we use multiple autonomous agents operating in a common environment to address the sequential decision-making problem to optimize the long-term rewards. In MACA, first we predict the mobility of vehicles using Teammate-Learning model as it allows the vehicles to cooperate and collaborate with each other without prior coordination. Secondly, during SMDP resource allocation phase, MARL inputs are applied to the Action Selection model for each vehicle based on their priorities. This is done at Road-Side Units (RSUs). Through numerical results and evaluations, we verify that the proposed method demonstrates efficient channel allocation and high packet delivery ratio as compared in the scenario of vehicles with multiple (high, medium, and low) priorities to existing conventional SMDP and Greedy algorithms.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] Multi-Agent Reinforcement Learning Resources Allocation Method Using Dueling Double Deep Q-Network in Vehicular Networks
    Ji, Yuxin
    Wang, Yu
    Zhao, Haitao
    Gui, Guan
    Gacanin, Haris
    Sari, Hikmet
    Adachi, Fumiyuki
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (10) : 13447 - 13460
  • [22] Radio Resource Allocation for 5G Networks Using Deep Reinforcement Learning
    Munaye, Yirga Yayeh
    Lin, Hsin-Piao
    Lin, Ding-Bing
    Juang, Rong-Terng
    Tarekegn, Getaneh Berie
    Jeng, Shiann-Shiun
    2021 30TH WIRELESS AND OPTICAL COMMUNICATIONS CONFERENCE (WOCC 2021), 2021, : 66 - 69
  • [23] Specification Aware Multi-Agent Reinforcement Learning
    Ritz, Fabian
    Phan, Thomy
    Mueller, Robert
    Gabor, Thomas
    Sedlmeier, Andreas
    Zeller, Marc
    Wieghardt, Jan
    Schmid, Reiner
    Sauer, Horst
    Klein, Cornel
    Linnhoff-Popien, Claudia
    AGENTS AND ARTIFICIAL INTELLIGENCE, ICAART 2021, 2022, 13251 : 3 - 21
  • [24] Multi-agent reinforcement learning for intelligent resource allocation in IIoT networks
    Rosenberger, Julia
    Urlaub, Michael
    Schramm, Dieter
    2021 IEEE GLOBAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND INTERNET OF THINGS (GCAIOT), 2021, : 118 - 119
  • [25] Multi-Agent Deep Reinforcement Learning for Enhancement of Distributed Resource Allocation in Vehicular Network
    Urmonov, Odilbek
    Aliev, Hayotjon
    Kim, HyungWon
    IEEE SYSTEMS JOURNAL, 2023, 17 (01): : 491 - 502
  • [26] A Hybrid Multi-Agent Reinforcement Learning Approach for Spectrum Sharing in Vehicular Networks
    Jamal, Mansoor
    Ullah, Zaib
    Naeem, Muddasar
    Abbas, Musarat
    Coronato, Antonio
    FUTURE INTERNET, 2024, 16 (05)
  • [27] Multi-Agent Deep Reinforcement Learning in Vehicular OCC
    Islam, Amirul
    Musavian, Leila
    Thomos, Nikolaos
    2022 IEEE 95TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-SPRING), 2022,
  • [28] Multi-agent deep reinforcement learning-based partial offloading and resource allocation in vehicular edge computing networks
    Xue, Jianbin
    Wang, Luyao
    Yu, Qingda
    Mao, Peipei
    COMPUTER COMMUNICATIONS, 2025, 234
  • [29] Learning Hierarchical Resource Allocation and Multi-agent Coordination of 5G mobile IAB Nodes
    Sana, Mohamed
    Miscopein, Benoit
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 4218 - 4223
  • [30] Multi-objective Resource Allocation for 5G Using Hierarchical Reinforcement Learning
    Akyildiz, Hasan Anil
    Gemici, Omer Faruk
    Hokelek, Ibrahim
    Cirpan, Hakan Ali
    2022 IEEE INTERNATIONAL BLACK SEA CONFERENCE ON COMMUNICATIONS AND NETWORKING (BLACKSEACOM), 2022, : 202 - 207