Crowd evacuation path planning and simulation method based on deep reinforcement learning and repulsive force field

被引:0
|
作者
Wang, Hongyue [1 ,2 ]
Liu, Hong [1 ,2 ]
Li, Wenhao [1 ,2 ]
机构
[1] Shandong Normal Univ, Sch Informat Sci & Engn, Jinan, Peoples R China
[2] Shandong Prov Key Lab Novel Distributed Comp Softw, Jinan, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep reinforcement learning; Path planning; Computer simulation; Crowd evacuation simulation;
D O I
10.1007/s10489-024-06074-w
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Path planning is essential for simulating crowd evacuation. However, existing path planning methods encounter challenges, including unbalanced exit utilization, ineffective obstacle avoidance, and low evacuation efficiency. To address these issues, this paper presents a path planning method based on Deep Reinforcement Learning (DRL) and a Repulsive Force Field (RFF) for crowd evacuation simulation. First, a dynamic exit scoring mechanism is proposed and integrated into the DRL training process to balance exit utilization during evacuation. Additionally, we address the sparse reward issue in DRL by extracting key points from actual evacuation trajectories as short-term goals. Finally, we enhance the movement strategy output by constructing an RFF to improve obstacle avoidance in complex environments. Experimental results demonstrate that the proposed method effectively avoids obstacles and efficiently completes evacuation tasks.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] A path planning method based on deep reinforcement learning for crowd evacuation
    Meng X.
    Liu H.
    Li W.
    Journal of Ambient Intelligence and Humanized Computing, 2024, 15 (6) : 2925 - 2939
  • [2] A double-layer crowd evacuation simulation method based on deep reinforcement learning
    Zhang, Yong
    Yang, Bo
    Zhu, Jianlin
    COMPUTER ANIMATION AND VIRTUAL WORLDS, 2024, 35 (03)
  • [3] Crowd Evacuation Simulation Using Hierarchical Deep Reinforcement Learning
    Zhang, Zheng
    Lu, Dianjie
    Li, Jialiuyuan
    Liu, Pingshan
    Zhang, Guijuan
    PROCEEDINGS OF THE 2021 IEEE 24TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN (CSCWD), 2021, : 563 - 568
  • [4] AFSA based path planning method for crowd evacuation
    Lu, Dianjie
    Zhang, Guijuan
    Liu, Yiliang
    Wang, Dequan
    Liu, Hong
    Journal of Information and Computational Science, 2014, 11 (11): : 3815 - 3823
  • [5] A UAV Path Planning Method Based on Deep Reinforcement Learning
    Li, Yibing
    Zhang, Sitong
    Ye, Fang
    Jiang, Tao
    Li, Yingsong
    2020 IEEE USNC-CNC-URSI NORTH AMERICAN RADIO SCIENCE MEETING (JOINT WITH AP-S SYMPOSIUM), 2020, : 93 - 94
  • [6] Improved Robot Path Planning Method Based on Deep Reinforcement Learning
    Han, Huiyan
    Wang, Jiaqi
    Kuang, Liqun
    Han, Xie
    Xue, Hongxin
    SENSORS, 2023, 23 (12)
  • [7] Path planning of manipulator based on deep reinforcement learning and screw method
    Wang Y.
    Wang Y.-H.
    Yin Z.-Z.
    Wan P.
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2023, 40 (03): : 516 - 524
  • [8] Crowd Simulation by Deep Reinforcement Learning
    Lee, Jaedong
    Won, Jungdam
    Lee, Jehee
    ACM SIGGRAPH CONFERENCE ON MOTION, INTERACTION, AND GAMES (MIG 2018), 2018,
  • [9] Improved Multi-Agent Reinforcement Learning for Path Planning-Based Crowd Simulation
    Wang, Qingqing
    Liu, Hong
    Gao, Kaizhou
    Zhang, Le
    IEEE ACCESS, 2019, 7 : 73841 - 73855
  • [10] Crowd evacuation simulation method combining the density field and social force model
    Sun, Yutong
    Liu, Hong
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2021, 566