A multi-agent reinforcement learning based approach for intelligent traffic signal control

被引:0
|
作者
Benhamza, Karima [1 ]
Seridi, Hamid [1 ]
Agguini, Meriem [2 ]
Bentagine, Amel [2 ]
机构
[1] Univ 08 May 1945, LabSTIC, Guelma, Algeria
[2] Univ 08 May 1945, Comp Sci Dept, Guelma, Algeria
关键词
Multi-agent reinforcement learning; Traffic signal control; Congestion management; Mutual reward; Replay memory; Urban traffic optimization; OPTIMIZATION; INTERSECTION;
D O I
10.1007/s12530-024-09622-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study addresses the intricate challenges of urban traffic congestion by presenting a novel Multi-Agent Reinforcement Learning (MARL) approach. In response to the critical need for adaptive traffic management solutions in multiple intersections networks, the proposed model integrates a dual-tiered reward system, encompassing personalized and mutual rewards, alongside the incorporation of the replay memory concept. This integration aims to thoroughly evaluate traffic light contributions and enhance traffic signal control strategies. The carefully defined parameters within the reward function are closely aligned with overarching system objectives, specifically targeting the minimization of congestion, delays, and emergency response times. Through simulated scenarios featuring diverse traffic conditions, the proposed MARL model exhibits promising outcomes, demonstrating remarkable adaptability and efficiency even under high traffic volumes. Comparative results with traditional methods, including fixed-time, actuated control, green wave strategy and distributed multi-agent Q-learning method, show the model's robust learning and adaptive capabilities, resulting in substantial reductions in queue lengths and delays. These results validate the model's effectiveness in optimizing traffic flow and efficiently managing congestion, thus making a significant contribution to the advancement of intelligent traffic systems.
引用
收藏
页码:2383 / 2397
页数:15
相关论文
共 50 条
  • [41] Multi-Agent Meta-Reinforcement Learning with Coordination and Reward Shaping for Traffic Signal Control
    Du, Xin
    Wang, Jiahai
    Chen, Siyuan
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2023, PT II, 2023, 13936 : 349 - 360
  • [42] A Distributed Multi-Agent Reinforcement Learning With Graph Decomposition Approach for Large-Scale Adaptive Traffic Signal Control
    Jiang, Shan
    Huang, Yufei
    Jafari, Mohsen
    Jalayer, Mohammad
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (09) : 14689 - 14701
  • [43] Traffic Distribution Algorithm Based on Multi-Agent Reinforcement Learning
    Cheng C.
    Teng J.-J.
    Zhao Y.-L.
    Song M.
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2019, 42 (06): : 43 - 48and57
  • [44] Distributed and coordinated traffic signal control approach based on multi-agent system
    Cheng, Xiang-Jun
    Du, Peng
    Yang, Zhao-Xia
    Xitong Gongcheng Lilun yu Shijian/System Engineering Theory and Practice, 2005, 25 (08): : 130 - 135
  • [45] Adaptive multi-objective reinforcement learning with hybrid exploration for traffic signal control based on cooperative multi-agent framework
    Khamis, Mohamed A.
    Gomaa, Walid
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2014, 29 : 134 - 151
  • [46] Traffic Optimization in Satellites Communications: A Multi-agent Reinforcement Learning Approach
    Qin, Zeyu
    Yao, Haipeng
    Mai, Tianle
    2020 16TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC, 2020, : 269 - 273
  • [47] A traffic light control method based on multi-agent deep reinforcement learning algorithm
    Liu, Dongjiang
    Li, Leixiao
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [48] A traffic light control method based on multi-agent deep reinforcement learning algorithm
    Dongjiang Liu
    Leixiao Li
    Scientific Reports, 13
  • [49] A Reinforcement Learning Approach for Intelligent Traffic Signal Control at Urban Intersections
    Guo, Mengyu
    Wang, Pin
    Chan, Ching-Yao
    Askary, Sid
    2019 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2019, : 4242 - 4247
  • [50] Analyzing communication policies in cooperative multi-agent reinforcement learning for traffic signal control: A simulation-based study
    Abidi, Sofiene
    Mathieu, Philippe
    Nongaillard, Antoine
    SIMULATION MODELLING PRACTICE AND THEORY, 2025, 141