Emergency fire escape path planning model based on improved DDPG algorithm

被引:3
|
作者
Feng, Zengxi [1 ,2 ]
Wang, Chang [1 ]
An, Jianhu [1 ]
Zhang, Xian [1 ]
Liu, Xuefeng [1 ]
Ji, Xiuming [1 ]
Kang, Limin [1 ]
Quan, Wei [1 ]
机构
[1] Xian Univ Architecture & Technol, Sch Bldg Serv Sci & Engn, Xian 710055, Peoples R China
[2] Minist Educ, Engn Res Ctr Bldg Energy Efficiency Control & Eval, Beijing, Peoples R China
来源
关键词
Evacuation; Path planning; Deep deterministic policy gradient; Reinforcement learning;
D O I
10.1016/j.jobe.2024.110090
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Currently, there is a growing demand for fire emergency evacuation capability of buildings. However, current plans based on pre-established static evacuation routes, fail to consider the dynamic nature of real-time fire scenarios. The objective of this paper is to propose a path planning model for fire emergency scenarios. The model is designed to provide evacuation paths for stranded individuals based on fire-related factors. Firstly, the model acquires relevant data through fire simulation, defines the reward function, and establishes an environment for training the agent. Secondly, the Deep Deterministic Policy Gradient (DDPG) algorithm is improved for the characteristics of the fire scenario. The intrinsic motivation was introduced to the DDPG to enhance its ability to explore the state space, and the hindsight experience replay strategy was implemented to improve the algorithm's training effectiveness. For the hyperparameter sensitivity problem in reinforcement learning, the Beluga Whale Optimization algorithm was employed for hyperparameter optimization. The experimental results show that the reinforcement learning model can plan evacuation paths starting from any location, and the final paths effectively balance the trade-off between risk and distance cost in the environment. The improved DDPG algorithm converges to increase the average reward by about 100, and the applicability of the model is verified in different fire environments. The application of the model can provide a good basis for the selection of emergency evacuation paths, and it has theoretical and practical value for the designation of scientific evacuation plans and the evaluation of the performance of building emergency systems.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Robot path planning algorithm with improved DDPG algorithm
    Lyu, Pingli
    INTERNATIONAL JOURNAL OF INTERACTIVE DESIGN AND MANUFACTURING - IJIDEM, 2025, 19 (02): : 1123 - 1133
  • [2] Ancient village fire escape path planning based on improved ant colony algorithm
    Xia, Wei
    Cao, Kang
    Hu, QianChuan
    3RD INTERNATIONAL CONFERENCE ON ADVANCES IN ENERGY, ENVIRONMENT AND CHEMICAL ENGINEERING, 2017, 69
  • [3] Indoor fire emergency evacuation path planning based on improved NavMesh algorithm
    Cao, Xianghong
    Wu, Kunning
    Geng, Xin
    Wang, Yongdong
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 45 (06) : 10757 - 10768
  • [4] Mobile Robot Path Planning Based on Improved DDPG Reinforcement Learning Algorithm
    Dong, Yuansheng
    Zou, Xingjie
    PROCEEDINGS OF 2020 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2020), 2020, : 52 - 55
  • [5] Research on Dynamic Path Planning of Mobile Robot Based on Improved DDPG Algorithm
    Li, Peng
    Ding, Xiangcheng
    Sun, Hongfang
    Zhao, Shiquan
    Cajo, Ricardo
    MOBILE INFORMATION SYSTEMS, 2021, 2021
  • [6] Emergency path planning based on improved ant colony algorithm
    Sun, Huakai
    Zhu, Kai
    Zhang, Weiguang
    Ke, Zhefeng
    Hu, Haihang
    Wu, Ke
    Zhang, Tianhang
    JOURNAL OF BUILDING ENGINEERING, 2025, 100
  • [7] A DDPG-Based USV Path-Planning Algorithm
    Zhao, Jian
    Wang, Pengrui
    Li, Baiyi
    Bai, Chunjiang
    APPLIED SCIENCES-BASEL, 2023, 13 (19):
  • [8] Path planning algorithm in complex environment based on DDPG and MPC
    Xue, Junxiao
    Kong, Xiangyan
    Wang, Gang
    Dong, Bowei
    Guan, Haiyang
    Shi, Lei
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 45 (01) : 1817 - 1831
  • [9] Research on escape route planning analysis in forest fire scenes based on the improved A* algorithm
    Zhu, Yulun
    Zhang, Gui
    Chu, Rong
    Xiao, Huashun
    Yang, Yongke
    Wu, Xin
    ECOLOGICAL INDICATORS, 2024, 166
  • [10] Improved Global Path Planning Algorithm Based on Ray Model
    Jiang L.
    Fang D.-J.
    Zhou H.-W.
    Huang H.-B.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2022, 50 (03): : 548 - 556