Emergency fire escape path planning model based on improved DDPG algorithm

被引:3
|
作者
Feng, Zengxi [1 ,2 ]
Wang, Chang [1 ]
An, Jianhu [1 ]
Zhang, Xian [1 ]
Liu, Xuefeng [1 ]
Ji, Xiuming [1 ]
Kang, Limin [1 ]
Quan, Wei [1 ]
机构
[1] Xian Univ Architecture & Technol, Sch Bldg Serv Sci & Engn, Xian 710055, Peoples R China
[2] Minist Educ, Engn Res Ctr Bldg Energy Efficiency Control & Eval, Beijing, Peoples R China
来源
关键词
Evacuation; Path planning; Deep deterministic policy gradient; Reinforcement learning;
D O I
10.1016/j.jobe.2024.110090
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Currently, there is a growing demand for fire emergency evacuation capability of buildings. However, current plans based on pre-established static evacuation routes, fail to consider the dynamic nature of real-time fire scenarios. The objective of this paper is to propose a path planning model for fire emergency scenarios. The model is designed to provide evacuation paths for stranded individuals based on fire-related factors. Firstly, the model acquires relevant data through fire simulation, defines the reward function, and establishes an environment for training the agent. Secondly, the Deep Deterministic Policy Gradient (DDPG) algorithm is improved for the characteristics of the fire scenario. The intrinsic motivation was introduced to the DDPG to enhance its ability to explore the state space, and the hindsight experience replay strategy was implemented to improve the algorithm's training effectiveness. For the hyperparameter sensitivity problem in reinforcement learning, the Beluga Whale Optimization algorithm was employed for hyperparameter optimization. The experimental results show that the reinforcement learning model can plan evacuation paths starting from any location, and the final paths effectively balance the trade-off between risk and distance cost in the environment. The improved DDPG algorithm converges to increase the average reward by about 100, and the applicability of the model is verified in different fire environments. The application of the model can provide a good basis for the selection of emergency evacuation paths, and it has theoretical and practical value for the designation of scientific evacuation plans and the evaluation of the performance of building emergency systems.
引用
收藏
页数:21
相关论文
共 50 条
  • [41] Planetary Rover Path Planning Based on Improved A* Algorithm
    Wu, Weihuai
    Xie, Xiaomei
    Wei, Mingzhu
    Liu, Nian
    Chen, Xin
    Yan, Peng
    Omar, Mechali
    Xu, Limei
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PT IV, 2019, 11743 : 341 - 353
  • [42] Bidirectional Path Planning Based on Improved Genetic Algorithm
    Xu, Jie
    Xu, Likai
    2ND INTERNATIONAL CONFERENCE ON APPLIED MATHEMATICS, MODELLING, AND INTELLIGENT COMPUTING (CAMMIC 2022), 2022, 12259
  • [43] UAV path planning based on the improved PPO algorithm
    Qi, Chenyang
    Wu, Chengfu
    Lei, Lei
    Li, Xiaolu
    Cong, Peiyan
    2022 ASIA CONFERENCE ON ADVANCED ROBOTICS, AUTOMATION, AND CONTROL ENGINEERING (ARACE 2022), 2022, : 193 - 199
  • [44] Research on Evacuation Path Planning in Fire Environment with Improved Ant Colony Algorithm
    Du, Yun
    Liu, Xiaoyu
    Jia, Kejin
    Ding, Li
    Huang, Gongfa
    Computer Engineering and Applications, 2024, 60 (08) : 309 - 319
  • [45] Path Planning Algorithm for Manipulators based on an improved Backtracking Search Algorithm
    Islam, Md. Nazrul
    Gallardo-Alvardo, Jaime
    Ahmad, Othman bin Hj
    Mamat, Mazlina Binti
    Ghosh, B. K.
    2015 5TH INTERNATIONAL CONFERENCE ON IT CONVERGENCE AND SECURITY (ICITCS), 2015,
  • [46] DDPG-based path planning approach for autonomous driving
    Li, Yimin
    Chen, Yanfang
    Li, Tianru
    Lao, Jingtao
    Li, Xuefang
    2023 IEEE 12TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE, DDCLS, 2023, : 1306 - 1311
  • [47] Path Planning for Mobile Robots Based on TPR-DDPG
    Zhao, Yaping
    Wang, Xiuqing
    Wang, Ruiyi
    Yang, Yunpeng
    Lv, Feng
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [48] Optimal path planning and data simulation of emergency material distribution based on improved neural network algorithm
    Chen, Min
    SOFT COMPUTING, 2023, 27 (09) : 5995 - 6005
  • [49] Design of Anti-Interference Path Planning for Cellular-Connected UAVs Based on Improved DDPG
    Zhou, Quanxi
    Wang, Yongjing
    PROCEEDINGS OF THE 2024 IEEE 10TH IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE AND SMART COMPUTING, HPSC 2024, 2024, : 71 - 76
  • [50] Research on Risk Evaluation and Dynamic Escape Path Planning Algorithm Based on Real-Time Spread of Ship Comprehensive Fire
    Ji, Jian
    Ma, Zhihao
    He, Jiajun
    Xu, Yingjun
    Liu, Zhiqiang
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2020, 8 (08)