Emergency fire escape path planning model based on improved DDPG algorithm

被引:4
|
作者
Feng, Zengxi [1 ,2 ]
Wang, Chang [1 ]
An, Jianhu [1 ]
Zhang, Xian [1 ]
Liu, Xuefeng [1 ]
Ji, Xiuming [1 ]
Kang, Limin [1 ]
Quan, Wei [1 ]
机构
[1] Xian Univ Architecture & Technol, Sch Bldg Serv Sci & Engn, Xian 710055, Peoples R China
[2] Minist Educ, Engn Res Ctr Bldg Energy Efficiency Control & Eval, Beijing, Peoples R China
来源
JOURNAL OF BUILDING ENGINEERING | 2024年 / 95卷
关键词
Evacuation; Path planning; Deep deterministic policy gradient; Reinforcement learning;
D O I
10.1016/j.jobe.2024.110090
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Currently, there is a growing demand for fire emergency evacuation capability of buildings. However, current plans based on pre-established static evacuation routes, fail to consider the dynamic nature of real-time fire scenarios. The objective of this paper is to propose a path planning model for fire emergency scenarios. The model is designed to provide evacuation paths for stranded individuals based on fire-related factors. Firstly, the model acquires relevant data through fire simulation, defines the reward function, and establishes an environment for training the agent. Secondly, the Deep Deterministic Policy Gradient (DDPG) algorithm is improved for the characteristics of the fire scenario. The intrinsic motivation was introduced to the DDPG to enhance its ability to explore the state space, and the hindsight experience replay strategy was implemented to improve the algorithm's training effectiveness. For the hyperparameter sensitivity problem in reinforcement learning, the Beluga Whale Optimization algorithm was employed for hyperparameter optimization. The experimental results show that the reinforcement learning model can plan evacuation paths starting from any location, and the final paths effectively balance the trade-off between risk and distance cost in the environment. The improved DDPG algorithm converges to increase the average reward by about 100, and the applicability of the model is verified in different fire environments. The application of the model can provide a good basis for the selection of emergency evacuation paths, and it has theoretical and practical value for the designation of scientific evacuation plans and the evaluation of the performance of building emergency systems.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Robot path planning algorithm with improved DDPG algorithm
    Lyu, Pingli
    INTERNATIONAL JOURNAL OF INTERACTIVE DESIGN AND MANUFACTURING - IJIDEM, 2025, 19 (02): : 1123 - 1133
  • [2] Indoor fire emergency evacuation path planning based on improved NavMesh algorithm
    Cao, Xianghong
    Wu, Kunning
    Geng, Xin
    Wang, Yongdong
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 45 (06) : 10757 - 10768
  • [3] Mobile Robot Path Planning Based on Improved DDPG Reinforcement Learning Algorithm
    Dong, Yuansheng
    Zou, Xingjie
    PROCEEDINGS OF 2020 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2020), 2020, : 52 - 55
  • [4] Emergency path planning based on improved ant colony algorithm
    Sun, Huakai
    Zhu, Kai
    Zhang, Weiguang
    Ke, Zhefeng
    Hu, Haihang
    Wu, Ke
    Zhang, Tianhang
    JOURNAL OF BUILDING ENGINEERING, 2025, 100
  • [5] A DDPG-Based USV Path-Planning Algorithm
    Zhao, Jian
    Wang, Pengrui
    Li, Baiyi
    Bai, Chunjiang
    APPLIED SCIENCES-BASEL, 2023, 13 (19):
  • [6] Path planning algorithm in complex environment based on DDPG and MPC
    Xue, Junxiao
    Kong, Xiangyan
    Wang, Gang
    Dong, Bowei
    Guan, Haiyang
    Shi, Lei
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 45 (01) : 1817 - 1831
  • [7] D*-KDDPG: An Improved DDPG Path-Planning Algorithm Integrating Kinematic Analysis and the D* Algorithm
    Liu, Chunyang
    Liu, Weitao
    Zhang, Dingfa
    Sui, Xin
    Huang, Yan
    Ma, Xiqiang
    Yang, Xiaokang
    Wang, Xiao
    APPLIED SCIENCES-BASEL, 2024, 14 (17):
  • [8] DDPG-based path planning approach for autonomous driving
    Li, Yimin
    Chen, Yanfang
    Li, Tianru
    Lao, Jingtao
    Li, Xuefang
    2023 IEEE 12TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE, DDCLS, 2023, : 1306 - 1311
  • [9] Design of Anti-Interference Path Planning for Cellular-Connected UAVs Based on Improved DDPG
    Zhou, Quanxi
    Wang, Yongjing
    PROCEEDINGS OF THE 2024 IEEE 10TH IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE AND SMART COMPUTING, HPSC 2024, 2024, : 71 - 76
  • [10] Research on Subway Fire Evacuation Path Planning Based on Improved Ant Colony Algorithm
    Duan, Ganglong
    Liu, Meng
    Kong, Weiwei
    Cui, Bowen
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 2896 - 2902