A multi-agent reinforcement learning based approach for intelligent traffic signal control

被引:0
|
作者
Benhamza, Karima [1 ]
Seridi, Hamid [1 ]
Agguini, Meriem [2 ]
Bentagine, Amel [2 ]
机构
[1] Univ 08 May 1945, LabSTIC, Guelma, Algeria
[2] Univ 08 May 1945, Comp Sci Dept, Guelma, Algeria
关键词
Multi-agent reinforcement learning; Traffic signal control; Congestion management; Mutual reward; Replay memory; Urban traffic optimization; OPTIMIZATION; INTERSECTION;
D O I
10.1007/s12530-024-09622-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study addresses the intricate challenges of urban traffic congestion by presenting a novel Multi-Agent Reinforcement Learning (MARL) approach. In response to the critical need for adaptive traffic management solutions in multiple intersections networks, the proposed model integrates a dual-tiered reward system, encompassing personalized and mutual rewards, alongside the incorporation of the replay memory concept. This integration aims to thoroughly evaluate traffic light contributions and enhance traffic signal control strategies. The carefully defined parameters within the reward function are closely aligned with overarching system objectives, specifically targeting the minimization of congestion, delays, and emergency response times. Through simulated scenarios featuring diverse traffic conditions, the proposed MARL model exhibits promising outcomes, demonstrating remarkable adaptability and efficiency even under high traffic volumes. Comparative results with traditional methods, including fixed-time, actuated control, green wave strategy and distributed multi-agent Q-learning method, show the model's robust learning and adaptive capabilities, resulting in substantial reductions in queue lengths and delays. These results validate the model's effectiveness in optimizing traffic flow and efficiently managing congestion, thus making a significant contribution to the advancement of intelligent traffic systems.
引用
收藏
页码:2383 / 2397
页数:15
相关论文
共 50 条
  • [1] Multi-Agent Reinforcement Learning for Traffic Signal Control: A Cooperative Approach
    Kolat, Mate
    Kovari, Balint
    Becsi, Tamas
    Aradi, Szilard
    SUSTAINABILITY, 2023, 15 (04)
  • [2] Multi-agent Reinforcement Learning for Traffic Signal Control
    Prabuchandran, K. J.
    Kumar, Hemanth A. N.
    Bhatnagar, Shalabh
    2014 IEEE 17TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2014, : 2529 - 2534
  • [3] Cooperative Traffic Signal Control Based on Multi-agent Reinforcement Learning
    Gao, Ruowen
    Liu, Zhihan
    Li, Jinglin
    Yuan, Quan
    BLOCKCHAIN AND TRUSTWORTHY SYSTEMS, BLOCKSYS 2019, 2020, 1156 : 787 - 793
  • [4] XLight: An interpretable multi-agent reinforcement learning approach for traffic signal control
    Cai, Sibin
    Fang, Jie
    Xu, Mengyun
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 273
  • [5] An Improved Traffic Signal Control Method Based on Multi-agent Reinforcement Learning
    Xu, Jianyou
    Zhang, Zhichao
    Zhang, Shuo
    Miao, Jiayao
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 6612 - 6616
  • [6] Multi-agent broad reinforcement learning for intelligent traffic light control
    Zhu, Ruijie
    Li, Lulu
    Wu, Shuning
    Lv, Pei
    Li, Yafei
    Xu, Mingliang
    INFORMATION SCIENCES, 2023, 619 : 509 - 525
  • [7] Multi-agent deep reinforcement learning with traffic flow for traffic signal control
    Hou, Liang
    Huang, Dailin
    Cao, Jie
    Ma, Jialin
    JOURNAL OF CONTROL AND DECISION, 2025, 12 (01) : 81 - 92
  • [8] A multi-agent deep reinforcement learning approach for traffic signal coordination
    Hu, Ta-Yin
    Li, Zhuo-Yu
    IET INTELLIGENT TRANSPORT SYSTEMS, 2024, 18 (08) : 1428 - 1444
  • [9] Hierarchical graph multi-agent reinforcement learning for traffic signal control
    Yang, Shantian
    INFORMATION SCIENCES, 2023, 634 : 55 - 72
  • [10] Causal inference multi-agent reinforcement learning for traffic signal control
    Yang, Shantian
    Yang, Bo
    Zeng, Zheng
    Kang, Zhongfeng
    INFORMATION FUSION, 2023, 94 : 243 - 256