Q value-based Dynamic Programming with SARSA Learning for real time route guidance in large scale road networks

被引:0
作者
Yu, Shanqing [1 ]
Zhou, Jing [1 ]
Li, Bing [1 ]
Mabu, Shingo [1 ]
Hirasawa, Kotaro [1 ]
机构
[1] Waseda Univ, Grad Sch Informat Prod & Syst, Wakamatsu Ku, Kitakyushu, Fukuoka 8080135, Japan
来源
2012 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN) | 2012年
关键词
SYSTEMS; MODEL;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a distributed dynamic traffic management model has been proposed to guide the vehicles, in order to minimize the computation time, make full use of real time traffic information and consequently improve the efficiency of the traffic system. For making the model work, we proposed a new dynamic route determination method, in which Q value-based Dynamic Programming and Sarsa Learning are combined to calculate the approximate optimal traveling time from each section to the destinations in the road networks. The proposed traffic management model is applied to the large scale microscopic simulator SOUND/4U based on the real world road network of Kurosaki, Kitakyushu in Japan. The simulation results show that the proposed method could reduce the traffic congestion and improve the efficiency of the traffic system effectively compared with the conventional method in the real world road network.
引用
收藏
页数:7
相关论文
共 20 条
  • [11] Optimal Route Based on Dynamic Programming for Road Networks
    Mainali, Manoj Kanta
    Shimada, Kaoru
    Mabu, Shingo
    Hirasawa, Kotaro
    [J]. JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2008, 12 (06) : 546 - 553
  • [12] Ning Jing, 1996, Proceedings of the 1996 ACM CIKM. International Conference on Information and Knowledge Management, P261, DOI 10.1145/238355.238550
  • [13] Rillings J. H., 1991, P VEH NAV INF SYST C, V2, P20
  • [14] Rummery G. A., 1994, Citeseer
  • [15] Shiose T., 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028), P574, DOI 10.1109/ICSMC.1999.812467
  • [16] Sutton RS, 1996, ADV NEUR IN, V8, P1038
  • [17] Integration of the global positioning system and geographical information systems for traffic congestion studies
    Taylor, MAP
    Woolley, JE
    Zito, R
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2000, 8 (1-6) : 257 - 285
  • [18] ALGORITHMS FOR FINDING AN OPTIMAL SET OF SHORT DISJOINT PATHS IN A COMMUNICATION-NETWORK
    TORRIERI, D
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 1992, 40 (11) : 1698 - 1702
  • [19] Multilayer Traffic Network Optimized by Multiobjective Genetic Clustering Algorithm
    Wen, Feng
    Gen, Mitsuo
    Yu, Xinjie
    [J]. IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2009, E92A (08) : 2107 - 2115
  • [20] Zhang Z, 2005, PROCEEDINGS OF 2005 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-9, P3607