Emergency fire escape path planning model based on improved DDPG algorithm

被引:3
|
作者
Feng, Zengxi [1 ,2 ]
Wang, Chang [1 ]
An, Jianhu [1 ]
Zhang, Xian [1 ]
Liu, Xuefeng [1 ]
Ji, Xiuming [1 ]
Kang, Limin [1 ]
Quan, Wei [1 ]
机构
[1] Xian Univ Architecture & Technol, Sch Bldg Serv Sci & Engn, Xian 710055, Peoples R China
[2] Minist Educ, Engn Res Ctr Bldg Energy Efficiency Control & Eval, Beijing, Peoples R China
来源
关键词
Evacuation; Path planning; Deep deterministic policy gradient; Reinforcement learning;
D O I
10.1016/j.jobe.2024.110090
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Currently, there is a growing demand for fire emergency evacuation capability of buildings. However, current plans based on pre-established static evacuation routes, fail to consider the dynamic nature of real-time fire scenarios. The objective of this paper is to propose a path planning model for fire emergency scenarios. The model is designed to provide evacuation paths for stranded individuals based on fire-related factors. Firstly, the model acquires relevant data through fire simulation, defines the reward function, and establishes an environment for training the agent. Secondly, the Deep Deterministic Policy Gradient (DDPG) algorithm is improved for the characteristics of the fire scenario. The intrinsic motivation was introduced to the DDPG to enhance its ability to explore the state space, and the hindsight experience replay strategy was implemented to improve the algorithm's training effectiveness. For the hyperparameter sensitivity problem in reinforcement learning, the Beluga Whale Optimization algorithm was employed for hyperparameter optimization. The experimental results show that the reinforcement learning model can plan evacuation paths starting from any location, and the final paths effectively balance the trade-off between risk and distance cost in the environment. The improved DDPG algorithm converges to increase the average reward by about 100, and the applicability of the model is verified in different fire environments. The application of the model can provide a good basis for the selection of emergency evacuation paths, and it has theoretical and practical value for the designation of scientific evacuation plans and the evaluation of the performance of building emergency systems.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Robot Path Planning Based on Improved Genetic Algorithm
    Zhao, Yuan
    Gu, Jason
    2013 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2013, : 2515 - 2522
  • [32] Path Planning of Mobile Robot Based on Improved A* Algorithm
    Lin, Mingxiu
    Yuan, Kai
    Shi, Chenzhi
    Wang, Yutong
    2017 29TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2017, : 3570 - 3576
  • [33] Workshop AGV path planning based on improved A* algorithm
    Liu, Na
    Ma, Chiyue
    Hu, Zihang
    Guo, Pengfei
    Ge, Yun
    Tian, Min
    Mathematical Biosciences and Engineering, 2024, 21 (02) : 2137 - 2162
  • [34] Path Planning of Improved RRT* Based on DBSCAN Algorithm
    Gao, MengJing
    Yan, Tian
    Li, QuanCheng
    Fu, WenXing
    Feng, ZhenFei
    PROCEEDINGS OF 2022 INTERNATIONAL CONFERENCE ON AUTONOMOUS UNMANNED SYSTEMS, ICAUS 2022, 2023, 1010 : 1973 - 1984
  • [35] Robotic Fish Path Planning based on an improved A* Algorithm
    Wang, Huan
    Jiang, Yulian
    INDUSTRIAL INSTRUMENTATION AND CONTROL SYSTEMS II, PTS 1-3, 2013, 336-338 : 968 - 972
  • [36] A global path planning algorithm based on improved RRT*
    Xu W.
    Yang Y.
    Yu L.-T.
    Zhu L.
    Kongzhi yu Juece/Control and Decision, 2022, 37 (04): : 829 - 838
  • [37] UAV Path Planning based on Improved Dragonfly Algorithm
    Hou, Yanjun
    Ke, Chenqi
    Chen, Siying
    Tang, Daoming
    Wu, Chenyin
    2024 IEEE 4TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND ARTIFICIAL INTELLIGENCE, SEAI 2024, 2024, : 283 - 288
  • [38] Research for Path Planning Based on Improved Astart Algorithm
    Pan, Hu
    Guo, Chen
    Wang, Zhaodong
    2017 4TH INTERNATIONAL CONFERENCE ON INFORMATION, CYBERNETICS AND COMPUTATIONAL SOCIAL SYSTEMS (ICCSS), 2017, : 225 - 230
  • [39] Flight path planning based on an improved genetic algorithm
    Ji Xiao-ting
    Xie Hai-bin
    Zhou Li
    Jia Sheng-de
    2013 THIRD INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEM DESIGN AND ENGINEERING APPLICATIONS (ISDEA), 2013, : 775 - 778
  • [40] Path planning of mobile robots based on improved A* algorithm
    Huang, Yonlin
    Guo, Shijie
    2022 ASIA CONFERENCE ON ADVANCED ROBOTICS, AUTOMATION, AND CONTROL ENGINEERING (ARACE 2022), 2022, : 133 - 137