Multi-Junction Traffic Light Control System with Reinforcement Learning in Sunway Smart City

被引:1
作者
Lam, Hao Cheng [1 ]
Wong, Richard T. K. [1 ]
Jasser, Muhammed Basheer [1 ,2 ]
Chua, Hui Na [1 ]
Issa, Bayan [3 ]
机构
[1] Sunway Univ, Sch Engn & Technol, Dept Comp & Informat Syst, Jalan Univ, Bandar Sunway 47500, Selangor Darul, Malaysia
[2] Sunway Univ, Res Ctr Human Machine Collaborat HUMAC, Sch Engn & Technol, Jalan Univ, Bandar Sunway 47500, Selangor Darul, Malaysia
[3] Univ Aleppo, Fac Informat Engn, Aleppo, Syria
来源
2024 IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC CONTROL AND INTELLIGENT SYSTEMS, I2CACIS 2024 | 2024年
关键词
reinforcement learning; q-learning; Markov decision process; traffic light control; adaptive traffic light system; NEURAL-NETWORKS; SIGNAL CONTROL; OPTIMIZATION;
D O I
10.1109/I2CACIS61270.2024.10649841
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents a reinforcement learning approach to address urban traffic congestion with traffic light control optimization. The proposed system leverages Q-learning and Markov Decision Processes (MDPs) to develop an adaptive control framework capable of adjusting traffic signal timings dynamically. A neural network model is employed to estimate Q-values, representing cumulative rewards for various control actions. The training process involves interactions between the agent and a simulated traffic environment using the Simulation of Urban Mobility (SUMO) tool. Experimental results showcase the efficacy of the RL-based approach in mitigating congestion and improving traffic flow. This work focuses on the case study of a network of junctions that contribute to the main traffic flow in the township of Bandar Sunway.
引用
收藏
页码:445 / 450
页数:6
相关论文
共 17 条
[1]   Stepwise genetic fuzzy logic signal control under mixed traffic conditions [J].
Chiou, Yu-Chiun ;
Huang, Yen-Fei .
JOURNAL OF ADVANCED TRANSPORTATION, 2013, 47 (01) :43-60
[2]  
Emambocus Bibi Aamirah Shafaa, 2023, 2023 IEEE 13th International Conference on Control System, Computing and Engineering (ICCSCE), P269, DOI 10.1109/ICCSCE58721.2023.10237155
[3]   An optimized Continuous Dragonfly Algorithm Using Hill Climbing Local Search to Tackle the Low Exploitation Problem [J].
Emambocus, Bibi Aamirah Shafaa ;
Jasser, Muhammed Basheer .
IEEE ACCESS, 2022, 10 :95030-95045
[4]  
Huang Y., 2020, Deep Reinforcement Learning: Fundamentals, Research and Applications, P135
[5]   Harris Hawk Optimization-Based Deep Neural Networks Architecture for Optimal Bidding in the Electricity Market [J].
Jain, Kavita ;
Jasser, Muhammed Basheer ;
Hamzah, Muzaffar ;
Saxena, Akash ;
Mohamed, Ali Wagdy .
MATHEMATICS, 2022, 10 (12)
[6]  
Lillicrap T.P., 2015, arXiv
[7]  
Medina J. C., 2012, P 91 ANN M TRANSP RE
[8]  
Ming Benjamin Ooi Joon, 2023, 2023 IEEE 13th International Conference on System Engineering and Technology (ICSET), P340, DOI 10.1109/ICSET59111.2023.10295096
[9]  
Puterman Martin L., 2014, Markov Decision Processes: Discrete Stochastic Dynamic Programming
[10]  
Salkham A., 2008, 2008 IEEE WIC ACM IN