Deep Reinforcement Learning based Traffic Signal Optimization for Multiple Intersections in ITS

被引:6
作者
Paul, Ananya [1 ]
Mitra, Sulata [1 ]
机构
[1] IIEST, Dept Comp Sci & Technol, Sibpur, Howrah, India
来源
2020 IEEE INTERNATIONAL CONFERENCE ON ADVANCED NETWORKS AND TELECOMMUNICATIONS SYSTEMS (IEEE ANTS) | 2020年
关键词
Reinforcement Learning; Deep Learning; Policy Gradient; Traffic Signal Optimization;
D O I
10.1109/ANTS50601.2020.9342819
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
The number of vehicles is drastically increasing worldwide, especially in large cities. Thus there is a need to model and enhance the traffic management to help meet this rising requirement. The primary purpose of traffic management is to reduce traffic congestion by optimizing traffic signal, which is currently one of the main concerns. Reinforcement Learning (RL) approaches in Intelligent Transportation System (ITS) are infeasible for traffic management of large road networks. However, Deep Reinforcement Learning (DRL) is capable of handling this enlarged problem. In order to manage the traffic flow of a large road network, there is a strong need for coordination between traffic signals of the intersections, enabling vehicles to pass through intersections more easily. In this paper, a single DRL agent manages the traffic signal of multiple intersections using policy gradient algorithm. In particular, the agent is trained with spatio-temporal data of the environment that allows it to perform action in different deep neural network models. The simulation experiment is studied in terms of three different simulation metrics. The proposed system outperforms while comparing it with the baseline i.e. fixed signal duration systems.
引用
收藏
页数:6
相关论文
共 11 条
  • [1] Bakker B, 2010, STUD COMPUT INTELL, V281, P475
  • [2] Brockman Greg, 2016, arXiv
  • [3] Garg D, 2019, IEEE INT C INTELL TR, P4222, DOI 10.1109/ITSC.2019.8917361
  • [4] Deep Reinforcement Learning for Intelligent Transportation Systems: A Survey
    Haydari, Ammar
    Yilmaz, Yasin
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (01) : 11 - 32
  • [5] Applications of computational intelligence in vehicle traffic congestion problem: a survey
    Jabbarpour, Mohammad Reza
    Zarrabi, Houman
    Khokhar, Rashid Hafeez
    Shamshirband, Shahaboddin
    Choo, Kim-Kwang Raymond
    [J]. SOFT COMPUTING, 2018, 22 (07) : 2299 - 2320
  • [6] A Deep Reinforcement Learning Network for Traffic Light Cycle Control
    Liang, Xiaoyuan
    Du, Xunsheng
    Wang, Guiling
    Han, Zhu
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (02) : 1243 - 1253
  • [7] Traffic light control using deep policy-gradient and value-function-based reinforcement learning
    Mousavi, Seyed Sajad
    Schukat, Michael
    Howley, Enda
    [J]. IET INTELLIGENT TRANSPORT SYSTEMS, 2017, 11 (07) : 417 - 423
  • [8] Time Critic Policy Gradient Methods for Traffic Signal Control in Complex and Congested Scenarios
    Rizzo, Stefano Giovanni
    Vantini, Giovanna
    Chawla, Sanjay
    [J]. KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, : 1654 - 1664
  • [9] IntelliLight: A Reinforcement Learning Approach for Intelligent Traffic Light Control
    Wei, Hua
    Zheng, Guanjie
    Yao, Huaxiu
    Li, Zhenhui
    [J]. KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, : 2496 - 2505
  • [10] Wu C, 2017, ARXIV171005465