A Reinforcement Learning-Based Congestion Control Approach for V2V Communication in VANET

被引:9
|
作者
Liu, Xiaofeng [1 ]
St Amour, Ben [1 ]
Jaekel, Arunita [1 ]
机构
[1] Univ Windsor, Sch Comp Sci, Windsor, ON N9B 3P4, Canada
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 06期
基金
加拿大自然科学与工程研究理事会;
关键词
VANET; congestion control; reinforcement learning; NETWORKS;
D O I
10.3390/app13063640
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Vehicular ad hoc networks (VANETs) are crucial components of intelligent transportation systems (ITS) aimed at enhancing road safety and providing additional services to vehicles and their users. To achieve reliable delivery of periodic status information, referred to as basic safety messages (BSMs) and event-driven alerts, vehicles need to manage the conflicting requirements of situational awareness and congestion control in a dynamic environment. To address this challenge, this paper focuses on controlling the message transmission rate through a Markov decision process (MDP) and solves it using a novel reinforcement learning (RL) algorithm. The proposed RL approach selects the most suitable transmission rate based on the current channel conditions, resulting in a balanced performance in terms of packet delivery and channel congestion, as shown by simulation results for different traffic scenarios. Additionally, the proposed approach offers increased flexibility for adaptive congestion control through the design of an appropriate reward function.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] A Q-learning based adaptive congestion control for V2V communication in VANET
    Liu, Xiaofeng
    Amour, Ben St.
    Jaekel, Arunita
    2022 INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING, IWCMC, 2022, : 847 - 852
  • [2] V2V Routing in VANET Based on Fuzzy Logic and Reinforcement Learning
    Zhang, W. L.
    Yang, X. Y.
    Song, Q. X.
    Zhao, L.
    INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, 2021, 16 (01) : 1 - 19
  • [3] Joint Congestion Control Strategy During V2V Communication Among Authentic Vehicles in VANET
    Sulata Mitra
    Atanu Mondal
    Wireless Personal Communications, 2014, 79 : 43 - 67
  • [4] Joint Congestion Control Strategy During V2V Communication Among Authentic Vehicles in VANET
    Mitra, Sulata
    Mondal, Atanu
    WIRELESS PERSONAL COMMUNICATIONS, 2014, 79 (01) : 43 - 67
  • [5] A Reinforcement Learning-based Radio Resource Management Algorithm for D2D-based V2V Communication
    Feki, Souhir
    Belghith, Aymen
    Zarai, Faouzi
    2019 15TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2019, : 1367 - 1372
  • [6] Coexistence of decentralized congestion control algorithms for V2V communication
    Math, Chetan Belagal
    Li, Hong
    Abanto-Leon, Luis F.
    de Groot, Sonia Heemstra
    Niemegeers, Ignas
    2018 IEEE 87TH VEHICULAR TECHNOLOGY CONFERENCE (VTC SPRING), 2018,
  • [7] Cooperative Reinforcement Learning based Adaptive Resource Allocation in V2V Communication
    Sharma, Sandeepika
    Singh, Brahmjit
    2019 6TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND INTEGRATED NETWORKS (SPIN), 2019, : 489 - 494
  • [8] Data Rate Based Congestion Control in V2V Communication for Traffic Safety Applications
    Math, Chetan Belagal
    Ozgur, Ahmet
    de Groot, Sonia Heemstra
    Li, Hong
    2015 IEEE SYMPOSIUM ON COMMUNICATIONS AND VEHICULAR TECHNOLOGY IN THE BENELUX (SCVT), 2015,
  • [9] Congestion Control in V2V Safety Communication: Problem, Analysis, Approaches
    Liu, Xiaofeng
    Jaekel, Arunita
    ELECTRONICS, 2019, 8 (05):
  • [10] Deep Reinforcement Learning based Congestion Control for V2X Communication
    Roshdi, Moustafa
    Bhadauria, Shubhangi
    Hassan, Khaled
    Fischer, Georg
    2021 IEEE 32ND ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2021,