Long-Term Pedestrian Trajectory Prediction Using Mutable Intention Filter and Warp LSTM

被引:20
作者
Huang, Zhe [1 ]
Hasan, Aamir [1 ]
Shin, Kazuki [1 ]
Li, Ruohua [1 ]
Driggs-Campbell, Katherine [1 ]
机构
[1] Univ Illinois, Dept Elect & Comp Engn, Urbana, IL 61801 USA
关键词
Human-centered robotics; intention recognition; modeling and simulating humans;
D O I
10.1109/LRA.2020.3047731
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Trajectory prediction is one of the key capabilities for robots to safely navigate and interact with pedestrians. Critical insights from human intention and behavioral patterns need to be integrated to effectively forecast long-term pedestrian behavior. Thus, we propose a framework incorporating a mutable intention filter and a Warp LSTM (MIF-WLSTM) to simultaneously estimate human intention and perform trajectory prediction. The mutable intention filter is inspired by particle filtering and genetic algorithms, where particles represent intention hypotheses that can be mutated throughout the pedestrian's motion. Instead of predicting sequential displacement over time, our Warp LSTM learns to generate offsets on a full trajectory predicted by a nominal intention-aware linear model, which considers the intention hypotheses during filtering process. Through experiments on a publicly available dataset, we show that our method outperforms baseline approaches and demonstrate the robust performance of our method under abnormal intention-changing scenarios.
引用
收藏
页码:542 / 549
页数:8
相关论文
共 47 条
[1]   Social LSTM: Human Trajectory Prediction in Crowded Spaces [J].
Alahi, Alexandre ;
Goel, Kratarth ;
Ramanathan, Vignesh ;
Robicquet, Alexandre ;
Li Fei-Fei ;
Savarese, Silvio .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :961-971
[2]   Discerning intentions in dynamic human action [J].
Baldwin, DA ;
Baird, JA .
TRENDS IN COGNITIVE SCIENCES, 2001, 5 (04) :171-178
[3]  
Bandyopadhyay T., 2013, ALGORITHMIC FDN ROBO, P475, DOI DOI 10.1007/978-3-642-36279-8_29
[4]  
Bartoli F, 2018, INT C PATT RECOG, P1941, DOI 10.1109/ICPR.2018.8545447
[5]   RED: A Simple but Effective Baseline Predictor for the TrajNet Benchmark [J].
Becker, Stefan ;
Hug, Ronny ;
Huebner, Wolfgang ;
Arens, Michael .
COMPUTER VISION - ECCV 2018 WORKSHOPS, PT III, 2019, 11131 :138-153
[6]   Perception of human motion [J].
Blake, Randolph ;
Shiffrar, Maggie .
ANNUAL REVIEW OF PSYCHOLOGY, 2007, 58 :47-73
[7]  
Carvalho JF, 2019, IEEE INT C INT ROBOT, P765, DOI [10.1109/IROS40897.2019.8968125, 10.1109/iros40897.2019.8968125]
[8]  
Dragan AD, 2013, ACMIEEE INT CONF HUM, P301, DOI 10.1109/HRI.2013.6483603
[9]  
Du P., P IEEE INT C INT TRA, V2020, P1
[10]   Soft plus Hardwired attention: An LSTM framework for human trajectory prediction and abnormal event detection [J].
Fernando, Tharindu ;
Denman, Simon ;
Sridharan, Sridha ;
Fookes, Clinton .
NEURAL NETWORKS, 2018, 108 :466-478