Emergency fire escape path planning model based on improved DDPG algorithm

被引:3
|
作者
Feng, Zengxi [1 ,2 ]
Wang, Chang [1 ]
An, Jianhu [1 ]
Zhang, Xian [1 ]
Liu, Xuefeng [1 ]
Ji, Xiuming [1 ]
Kang, Limin [1 ]
Quan, Wei [1 ]
机构
[1] Xian Univ Architecture & Technol, Sch Bldg Serv Sci & Engn, Xian 710055, Peoples R China
[2] Minist Educ, Engn Res Ctr Bldg Energy Efficiency Control & Eval, Beijing, Peoples R China
来源
关键词
Evacuation; Path planning; Deep deterministic policy gradient; Reinforcement learning;
D O I
10.1016/j.jobe.2024.110090
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Currently, there is a growing demand for fire emergency evacuation capability of buildings. However, current plans based on pre-established static evacuation routes, fail to consider the dynamic nature of real-time fire scenarios. The objective of this paper is to propose a path planning model for fire emergency scenarios. The model is designed to provide evacuation paths for stranded individuals based on fire-related factors. Firstly, the model acquires relevant data through fire simulation, defines the reward function, and establishes an environment for training the agent. Secondly, the Deep Deterministic Policy Gradient (DDPG) algorithm is improved for the characteristics of the fire scenario. The intrinsic motivation was introduced to the DDPG to enhance its ability to explore the state space, and the hindsight experience replay strategy was implemented to improve the algorithm's training effectiveness. For the hyperparameter sensitivity problem in reinforcement learning, the Beluga Whale Optimization algorithm was employed for hyperparameter optimization. The experimental results show that the reinforcement learning model can plan evacuation paths starting from any location, and the final paths effectively balance the trade-off between risk and distance cost in the environment. The improved DDPG algorithm converges to increase the average reward by about 100, and the applicability of the model is verified in different fire environments. The application of the model can provide a good basis for the selection of emergency evacuation paths, and it has theoretical and practical value for the designation of scientific evacuation plans and the evaluation of the performance of building emergency systems.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] Motion Planning of Six-DOF Arm Robot Based on Improved DDPG Algorithm
    Li, Zhuang
    Ma, Hongbin
    Ding, Yazhe
    Wang, Chen
    Jin, Ying
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 3954 - 3959
  • [22] ARA☆+: Improved path planning algorithm based on ARA☆
    Li, Bo
    Gong, Jianwei
    Jiang, Yan
    Nasry, Hany
    Xiong, Guangming
    2012 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE AND INTELLIGENT AGENT TECHNOLOGY (WI-IAT 2012), VOL 2, 2012, : 361 - 365
  • [23] An improved path planning algorithm based on fuel consumption
    Tianbo Liu
    Jindong Zhang
    The Journal of Supercomputing, 2022, 78 : 12973 - 13003
  • [24] A Path Planning Algorithm for Robots Based on Improved QPSO
    Tao, Chongyang
    Yang, Jihua
    Zhao, Hang
    INTERNATIONAL CONFERENCE ON COMPUTATIONAL AND INFORMATION SCIENCES (ICCIS 2014), 2014, : 548 - 554
  • [25] The Path Planning of Mobile Robots Based on an Improved A* Algorithm
    Chang, Lu
    Shan, Liang
    Li, Jun
    Dai, Yuewei
    PROCEEDINGS OF THE 2019 IEEE 16TH INTERNATIONAL CONFERENCE ON NETWORKING, SENSING AND CONTROL (ICNSC 2019), 2019, : 257 - 262
  • [26] Path planning of scenic spots based on improved A* algorithm
    Wang, Xingdong
    Zhang, Haowei
    Liu, Shuo
    Wang, Jialu
    Wang, Yuhua
    Shangguan, Donghui
    SCIENTIFIC REPORTS, 2022, 12 (01)
  • [27] An improved path planning algorithm based on fuel consumption
    Liu, Tianbo
    Zhang, Jindong
    JOURNAL OF SUPERCOMPUTING, 2022, 78 (11): : 12973 - 13003
  • [28] Improved Path Planning Algorithm Based Grid Maps
    Zheng, Han-Xu
    Zhang, Bo
    Beijing Ligong Daxue Xuebao/Transaction of Beijing Institute of Technology, 2019, 39 : 1 - 5
  • [29] Path planning of scenic spots based on improved A* algorithm
    Xingdong Wang
    Haowei Zhang
    Shuo Liu
    Jialu Wang
    Yuhua Wang
    Donghui Shangguan
    Scientific Reports, 12
  • [30] Mobile Robot Path Planning Based on an Improved A* Algorithm
    Zhao X.
    Wang Z.
    Huang C.
    Zhao Y.
    Zhao, Yanwei (zyw@zjut.edu.cn), 2018, Chinese Academy of Sciences (40): : 903 - 910