A reinforcement learning-based routing algorithm for large street networks

被引:21
作者
Li, Diya [1 ]
Zhang, Zhe [1 ,2 ]
Alizadeh, Bahareh [3 ]
Zhang, Ziyi [2 ]
Duffield, Nick [2 ,4 ]
Meyer, Michelle A. [5 ]
Thompson, Courtney M. [1 ]
Gao, Huilin [6 ]
Behzadan, Amir H. [3 ]
机构
[1] Texas A&M Univ, Dept Geog, College Stn, TX 77843 USA
[2] Texas A&M Univ, Dept Elect & Comp Engn, College Stn, TX 77843 USA
[3] Texas A&M Univ, Dept Construct Sci, College Stn, TX USA
[4] Texas A&M Inst Data Sci, College Stn, TX USA
[5] Texas A&M Univ, Dept Landscape Architecture & Urban Planning, College Stn, TX USA
[6] Texas A&M Univ, Dept Civil & Environm Engn, College Stn, TX USA
基金
美国海洋和大气管理局;
关键词
Disaster evacuation; reinforcement learning; Geographic Information Science and Systems (GIS); artificial intelligence; routing algorithm; FLOOD; TIME; MULTICRITERIA; INFORMATION; NAVIGATION;
D O I
10.1080/13658816.2023.2279975
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Evacuation planning and emergency routing systems are crucial in saving lives during disasters. Traditional emergency routing systems, despite their best efforts, often struggle to accurately capture the dynamic nature of flood conditions, road closures, and other real-time changes inherent in urban disaster logistics. This paper introduces the ReinforceRouting model, a novel approach to optimizing evacuation routes using reinforcement learning (RL). The model incorporates a unique RL environment that considers multiple criteria, such as traffic conditions, hazardous situations, and the availability of safe routes. The RL agent in this model learns optimal actions through interaction with the environment, receiving feedback in the form of rewards or penalties. The ReinforceRouting model excels in executing prompt and accurate route planning on large road networks, outperforming traditional RL algorithms and shortest-path-based algorithms. A higher safety score and episode reward of the model are demonstrated when compared to these classical methods. This innovative approach to disaster evacuation planning offers a promising avenue for enhancing the efficiency, safety, and reliability of emergency responses in dynamic urban environments.
引用
收藏
页码:183 / 215
页数:33
相关论文
共 111 条
[1]  
Abe K., 2019, ARXIV
[2]  
Agarap A.F., 2019, DEEP LEARNING USING
[3]  
Alizadeh B., 2021, ARXIV
[4]   Human-centered flood mapping and intelligent routing through augmenting flood gauge data with crowdsourced street photos [J].
Alizadeh, Bahareh ;
Li, Diya ;
Hillin, Julia ;
Meyer, Michelle A. ;
Thompson, Courtney M. ;
Zhang, Zhe ;
Behzadan, Amir H. .
ADVANCED ENGINEERING INFORMATICS, 2022, 54
[5]   Unravelling the influence of human behaviour on reducing casualties during flood evacuation [J].
Alonso Vicario, S. ;
Mazzoleni, M. ;
Bhamidipati, S. ;
Gharesifard, M. ;
Ridolfi, E. ;
Pandolfo, C. ;
Alfonso, L. .
HYDROLOGICAL SCIENCES JOURNAL, 2020, 65 (14) :2359-2375
[6]   Debunking the Myths of Influence Maximization: An In-Depth Benchmarking Study [J].
Arora, Akhil ;
Galhotra, Sainyam ;
Ranu, Sayan .
SIGMOD'17: PROCEEDINGS OF THE 2017 ACM INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2017, :651-666
[7]   A routing protocol for vehicular ad hoc networks using simulated annealing algorithm and neural networks [J].
Bagherlou, Hosein ;
Ghaffari, Ali .
JOURNAL OF SUPERCOMPUTING, 2018, 74 (06) :2528-2552
[8]  
Bennett J.:., 2010, OPENSTREETMAP
[9]   Evacuation route recommendation using auto-encoder and Markov decision process [J].
Bi, Chongke ;
Pan, Guosheng ;
Yang, Lu ;
Lin, Chun-Cheng ;
Hou, Min ;
Huang, Yuanqi .
APPLIED SOFT COMPUTING, 2019, 84
[10]  
Bohn E, 2019, INT CONF UNMAN AIRCR, P523, DOI [10.1109/ICUAS.2019.8798254, 10.1109/icuas.2019.8798254]