Modeling of route planning system based on Q value-based dynamic programming with multi-agent reinforcement learning algorithms

被引:64
作者
Zolfpour-Arokhlo, Mortaza [1 ]
Selamat, Ali [2 ]
Hashim, Siti Zaiton Mohd [2 ]
Afkhami, Hossein [3 ]
机构
[1] Islamic Azad Univ, Sepidan Branch, Dept Comp Engn, Sepidan, Iran
[2] Univ Teknol Malaysia, Fac Comp, Utm Skudai 81310, Johor, Malaysia
[3] Islamic Azad Univ, Sepidan Branch, Dept Elect & Power, Sepidan, Iran
关键词
Route planning system (RPS); Multi-agent system (MAS); Multi-agent reinforcement learning (MARL); Q-learning; Traffic congestion; AGENT TECHNOLOGY; OPTIMIZATION; MANAGEMENT;
D O I
10.1016/j.engappai.2014.01.001
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, a new model for a route planning system based on multi-agent reinforcement learning (MARL) algorithms is proposed. The combined Q-value based dynamic programming (QVDP) with Boltzmann distribution was used to solve vehicle delay's problems by studying the weights of various components in road network environments such as weather, traffic, road safety, and fuel capacity to create a priority route plan for vehicles. The important part of the study was to use a multi-agent system (MAS) with learning abilities which in order to make decisions about routing vehicles between Malaysia's cities. The evaluation was done using a number of case studies that focused on road networks in Malaysia. The results of these experiments indicated that the travel durations for the case studies predicted by existing approaches were between 0.00 and 12.33% off from the actual travel times by the proposed method. From the experiments, the results illustrate that the proposed approach is a unique contribution to the field of computational intelligence in the route planning system. (C) 2014 Elsevier Ltd. All rights reserved.
引用
收藏
页码:163 / 177
页数:15
相关论文
共 83 条
  • [1] A multi-agent approach to cooperative traffic management and route guidance
    Adler, JL
    Satapathy, G
    Manikonda, V
    Bowles, B
    Blue, VJ
    [J]. TRANSPORTATION RESEARCH PART B-METHODOLOGICAL, 2005, 39 (04) : 297 - 318
  • [2] A cooperative multi-agent transportation management and route guidance system
    Adler, JL
    Blue, VJ
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2002, 10 (5-6) : 433 - 454
  • [3] Akchurina N., 2010, THESIS U PADERBORN, P1
  • [4] An Intelligent Multi-agent Approach for Road Traffic Management Systems
    Almejalli, Khaled
    Dahal, Keshav
    Hossain, Alamgir
    [J]. 2009 IEEE CONTROL APPLICATIONS CCA & INTELLIGENT CONTROL (ISIC), VOLS 1-3, 2009, : 825 - 830
  • [5] Simulation and Analysis of Route Guidance Strategy Based on a Multi-agent-game Approach
    An Shi
    Cui Na
    Hu Chun-bin
    [J]. 2008 INTERNATIONAL CONFERENCE ON MANAGEMENT SCIENCE & ENGINEERING (15TH), VOLS I AND II, CONFERENCE PROCEEDINGS, 2008, : 140 - +
  • [6] [Anonymous], 2004, THESIS TU EINDHOVEN
  • [7] Reinforcement learning-based multi-agent system for network traffic signal control
    Arel, I.
    Liu, C.
    Urbanik, T.
    Kohls, A. G.
    [J]. IET INTELLIGENT TRANSPORT SYSTEMS, 2010, 4 (02) : 128 - 135
  • [8] Arokhlo M. Z., 2011, INT J ADV COMPUTING, V3, P224
  • [9] Awad E., 2011, THESIS MASDAT I SCI
  • [10] Bakker B., 2006, DOAS 2006 PROJECT RE