A multi-agent reinforcement learning based approach for intelligent traffic signal control

被引:0
作者
Benhamza, Karima [1 ]
Seridi, Hamid [1 ]
Agguini, Meriem [2 ]
Bentagine, Amel [2 ]
机构
[1] Univ 08 May 1945, LabSTIC, Guelma, Algeria
[2] Univ 08 May 1945, Comp Sci Dept, Guelma, Algeria
关键词
Multi-agent reinforcement learning; Traffic signal control; Congestion management; Mutual reward; Replay memory; Urban traffic optimization; OPTIMIZATION; INTERSECTION;
D O I
10.1007/s12530-024-09622-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study addresses the intricate challenges of urban traffic congestion by presenting a novel Multi-Agent Reinforcement Learning (MARL) approach. In response to the critical need for adaptive traffic management solutions in multiple intersections networks, the proposed model integrates a dual-tiered reward system, encompassing personalized and mutual rewards, alongside the incorporation of the replay memory concept. This integration aims to thoroughly evaluate traffic light contributions and enhance traffic signal control strategies. The carefully defined parameters within the reward function are closely aligned with overarching system objectives, specifically targeting the minimization of congestion, delays, and emergency response times. Through simulated scenarios featuring diverse traffic conditions, the proposed MARL model exhibits promising outcomes, demonstrating remarkable adaptability and efficiency even under high traffic volumes. Comparative results with traditional methods, including fixed-time, actuated control, green wave strategy and distributed multi-agent Q-learning method, show the model's robust learning and adaptive capabilities, resulting in substantial reductions in queue lengths and delays. These results validate the model's effectiveness in optimizing traffic flow and efficiently managing congestion, thus making a significant contribution to the advancement of intelligent traffic systems.
引用
收藏
页码:2383 / 2397
页数:15
相关论文
共 63 条
  • [1] Abdoos M, 2011, IEEE INT C INTELL TR, P1580, DOI 10.1109/ITSC.2011.6083114
  • [2] Reinforcement learning for True Adaptive traffic signal control
    Abdulhai, B
    Pringle, R
    Karakoulas, GJ
    [J]. JOURNAL OF TRANSPORTATION ENGINEERING, 2003, 129 (03) : 278 - 285
  • [3] Experience Replay for Real-Time Reinforcement Learning Control
    Adam, Sander
    Busoniu, Lucian
    Babuska, Robert
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2012, 42 (02): : 201 - 212
  • [4] Agarap A. F., 2018, ARXIV
  • [5] [Anonymous], 2015, Nature, DOI DOI 10.1038/NATURE14539
  • [6] Intelligent cuckoo search optimized traffic signal controllers for multi-intersection network
    Araghi, Sahar
    Khosravi, Abbas
    Creighton, Douglas
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2015, 42 (09) : 4422 - 4431
  • [7] Deep Reinforcement Learning A brief survey
    Arulkumaran, Kai
    Deisenroth, Marc Peter
    Brundage, Miles
    Bharath, Anil Anthony
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (06) : 26 - 38
  • [8] A comprehensive survey of multiagent reinforcement learning
    Busoniu, Lucian
    Babuska, Robert
    De Schutter, Bart
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2008, 38 (02): : 156 - 172
  • [9] Chen XF, 2002, 2002 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-4, PROCEEDINGS, P1245
  • [10] Cools SB., 2013, ADV APPL SELF ORG SY, P45, DOI DOI 10.1007/978-1-4471-5113-5_3