Q-Learning Traffic Signal Optimization within Multiple Intersections Traffic Network

被引:24
作者
Chin, Yit Kwong [1 ]
Kow, Wei Yeang [1 ]
Khong, Wei Leong [1 ]
Tan, Min Keng [1 ]
Teo, Kenneth Tze Kin [1 ]
机构
[1] Univ Malaysia Sabah, Sch Engn & Informat Technol, Modelling Simulat & Comp Lab, Mat & Mineral Res Unit, Kota Kinabalu, Malaysia
来源
2012 SIXTH UKSIM/AMSS EUROPEAN SYMPOSIUM ON COMPUTER MODELLING AND SIMULATION (EMS) | 2012年
关键词
Reinforcement learning; Q-Learning; Traffic networks; Traffic signal timing plan management; Multi-agents systems;
D O I
10.1109/EMS.2012.75
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Traffic flow optimization within traffic networks has been approached through different kinds of methods. One of the methods is to reconfigure the traffic signal timing plan. However, dynamic characteristic of the traffic flow is not able to be resolved by the conventional traffic signal timing plan management. As a result, traffic congestion still remains as an unsolved problem. Thus, in this study, artificial intelligence algorithm has been introduced in the traffic signal timing plan to enable the traffic management systems' learning ability. Q-Learning algorithm acts as the learning mechanism for traffic light intersections to release itself from traffic congestions situation. Adjacent traffic light intersections will work independently and yet cooperate with each other to a common goal of ensuring the fluency of the traffic flows within traffic network. The experimental results show that the Q-Learning algorithm is able to learn from the dynamic traffic flow and optimized the traffic flow.
引用
收藏
页码:343 / 348
页数:6
相关论文
共 15 条
[1]   Reinforcement learning for True Adaptive traffic signal control [J].
Abdulhai, B ;
Pringle, R ;
Karakoulas, GJ .
JOURNAL OF TRANSPORTATION ENGINEERING, 2003, 129 (03) :278-285
[2]   Reinforcement learning-based multi-agent system for network traffic signal control [J].
Arel, I. ;
Liu, C. ;
Urbanik, T. ;
Kohls, A. G. .
IET INTELLIGENT TRANSPORT SYSTEMS, 2010, 4 (02) :128-135
[3]   A Novel Fuzzy Model and Control of Single Intersection at Urban Traffic Network [J].
Azimirad, Ehsan ;
Pariz, Naser ;
Sistani, M. Bagher Naghibi .
IEEE SYSTEMS JOURNAL, 2010, 4 (01) :107-111
[4]   Urban traffic signal control using reinforcement learning agents [J].
Balaji, P. G. ;
German, X. ;
Srinivasan, D. .
IET INTELLIGENT TRANSPORT SYSTEMS, 2010, 4 (03) :177-188
[5]  
Chin Y. K., 2011, Proceedings of the 2011 IEEE International Conference on Control System, Computing and Engineering (ICCSCE), P454, DOI 10.1109/ICCSCE.2011.6190569
[6]  
Dai YJ, 2011, IEEE INT C INTELL TR, P1045, DOI 10.1109/ITSC.2011.6083027
[7]  
Garber N., 2002, TRAFFIC HIGHWAY ENG, V3rd
[8]   Adaptive traffic lights using car-to-car communication [J].
Gradinescu, Victor ;
Gorgorin, Cristian ;
Diaconescu, Raluca ;
Cristea, Valentin ;
Iftode, Liviu .
2007 IEEE 65TH VEHICULAR TECHNOLOGY CONFERENCE, VOLS 1-6, 2007, :21-25
[9]  
Kiring Aroland, 2011, Artic. Int. J. Simul. Syst. Sci. Technol., V12, P29
[10]  
Kok Khiang Tan, 1996, Malaysian Journal of Computer Science, V9, P29