Decentralized Multi Agent Deep Reinforcement Q-Learning for Intelligent Traffic Controller

被引:0
|
作者
Thamilselvam, B. [1 ]
Kalyanasundaram, Subrahmanyam [1 ]
Rao, M. V. Panduranga [1 ]
机构
[1] IIT Hyderabad, Dept Comp Sci & Engn, Kandi 502285, India
来源
ARTIFICIAL INTELLIGENCE APPLICATIONS AND INNOVATIONS, AIAI 2023, PT I | 2023年 / 675卷
关键词
Multi agent systems; Deep Reinforcement learning; Statistical Model checking; Traffic controller;
D O I
10.1007/978-3-031-34111-3_5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent development of deep reinforcement learning models has impacted many fields, especially decision based control systems. Urban traffic signal control minimizes traffic congestion as well as overall traffic delay. In this work, we use a decentralized multi-agent reinforcement learning model represented by a novel state and reward function. In comparison to other single agent models reported in literature, this approach uses minimal data collection to control the traffic lights. Our model is assessed using traffic data that has been synthetically generated. Additionally, we compare the outcomes to those of existing models and employ the Monaco SUMO Traffic (MoST) Scenario to examine real-time traffic data. Finally, we use statistical model checking (specifically, the Multi-VeStA) to check performance properties. Our model works well in all synthetic generated data and real time data.
引用
收藏
页码:45 / 56
页数:12
相关论文
共 50 条
  • [1] Deep Reinforcement Q-Learning for Intelligent Traffic Control in Mass Transit
    Khozam, Shurok
    Farhi, Nadir
    SUSTAINABILITY, 2023, 15 (14)
  • [2] Deep Reinforcement Q-Learning for Intelligent Traffic Signal Control with Partial Detection
    Romain Ducrocq
    Nadir Farhi
    International Journal of Intelligent Transportation Systems Research, 2023, 21 : 192 - 206
  • [3] Deep Reinforcement Q-Learning for Intelligent Traffic Signal Control with Partial Detection
    Ducrocq, Romain
    Farhi, Nadir
    INTERNATIONAL JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS RESEARCH, 2023, 21 (01) : 192 - 206
  • [4] Hysteretic Q-Learning : an algorithm for decentralized reinforcement learning in cooperative multi-agent teams
    Matignon, Laetitia
    Laurent, Guillaume J.
    Le Fort-Piat, Nadine
    2007 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-9, 2007, : 64 - 69
  • [5] Deep Q-Learning for Decentralized Multi-Agent Inspection of a Tumbling Target
    Aurand, Joshua
    Cutlip, Steven
    Lei, Henry
    Lang, Kendra
    Phillips, Sean
    JOURNAL OF SPACECRAFT AND ROCKETS, 2024, 61 (02) : 341 - 354
  • [6] Deep Reinforcement Learning: From Q-Learning to Deep Q-Learning
    Tan, Fuxiao
    Yan, Pengfei
    Guan, Xinping
    NEURAL INFORMATION PROCESSING (ICONIP 2017), PT IV, 2017, 10637 : 475 - 483
  • [7] Intelligent Decentralized Multiple Access via Multi-Agent Deep Reinforcement Learning
    He, Yuxuan
    Gang, Xinyuan
    Gao, Yayu
    2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [8] Multi-Agent Exploration for Faster and Reliable Deep Q-Learning Convergence in Reinforcement Learning
    Majumdar, Abhijit
    Benavidez, Patrick
    Jamshidi, Mo
    2018 WORLD AUTOMATION CONGRESS (WAC), 2018, : 222 - 227
  • [9] Multi-Agent Deep Reinforcement Learning for Decentralized Cooperative Traffic Signal Control
    Zhao, Yang
    Hu, Jian-Ming
    Gao, Ming-Yang
    Zhang, Zuo
    CICTP 2020: TRANSPORTATION EVOLUTION IMPACTING FUTURE MOBILITY, 2020, : 458 - 470
  • [10] Multi-Agent Reinforcement Learning - An Exploration Using Q-Learning
    Graham, Caoimhin
    Bell, David
    Luo, Zhihui
    RESEARCH AND DEVELOPMENT IN INTELLIGENT SYSTEMS XXVI: INCORPORATING APPLICATIONS AND INNOVATIONS IN INTELLIGENT SYSTEMS XVII, 2010, : 293 - 298