Long-Term Pedestrian Trajectory Prediction Using Mutable Intention Filter and Warp LSTM

被引:20
作者
Huang, Zhe [1 ]
Hasan, Aamir [1 ]
Shin, Kazuki [1 ]
Li, Ruohua [1 ]
Driggs-Campbell, Katherine [1 ]
机构
[1] Univ Illinois, Dept Elect & Comp Engn, Urbana, IL 61801 USA
关键词
Human-centered robotics; intention recognition; modeling and simulating humans;
D O I
10.1109/LRA.2020.3047731
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Trajectory prediction is one of the key capabilities for robots to safely navigate and interact with pedestrians. Critical insights from human intention and behavioral patterns need to be integrated to effectively forecast long-term pedestrian behavior. Thus, we propose a framework incorporating a mutable intention filter and a Warp LSTM (MIF-WLSTM) to simultaneously estimate human intention and perform trajectory prediction. The mutable intention filter is inspired by particle filtering and genetic algorithms, where particles represent intention hypotheses that can be mutated throughout the pedestrian's motion. Instead of predicting sequential displacement over time, our Warp LSTM learns to generate offsets on a full trajectory predicted by a nominal intention-aware linear model, which considers the intention hypotheses during filtering process. Through experiments on a publicly available dataset, we show that our method outperforms baseline approaches and demonstrate the robust performance of our method under abnormal intention-changing scenarios.
引用
收藏
页码:542 / 549
页数:8
相关论文
共 47 条
[11]  
Ferrer G, 2014, IEEE INT CONF ROBOT, P5940, DOI 10.1109/ICRA.2014.6907734
[12]  
Ghori O, 2018, IEEE INT VEH SYM, P1277, DOI 10.1109/IVS.2018.8500657
[13]  
Graves A., 2013, GENERATING SEQUENCES
[14]   Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks [J].
Gupta, Agrim ;
Johnson, Justin ;
Li Fei-Fei ;
Savarese, Silvio ;
Alahi, Alexandre .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2255-2264
[15]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[16]   SOCIAL FORCE MODEL FOR PEDESTRIAN DYNAMICS [J].
HELBING, D ;
MOLNAR, P .
PHYSICAL REVIEW E, 1995, 51 (05) :4282-4286
[17]  
Hochreiter S., 1997, Neural Computation, V9, P1735
[18]  
Hug R, 2018, IEEE INT C INTELL TR, P2684, DOI 10.1109/ITSC.2018.8569478
[19]  
Huynh D. Q., 2017, P IEE INT C DIG IM C, P1
[20]   The Trajectron: Probabilistic Multi-Agent Trajectory Modeling With Dynamic Spatiotemporal Graphs [J].
Ivanovic, Boris ;
Pavone, Marco .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :2375-2384