STIGCN: spatial-temporal interaction-aware graph convolution network for pedestrian trajectory prediction

被引:8
作者
Chen, Wangxing [1 ]
Sang, Haifeng [1 ]
Wang, Jinyu [1 ]
Zhao, Zishan [1 ]
机构
[1] Shenyang Univ Technol, Sch Informat Sci & Engn, Shenyang 110870, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Pedestrian trajectory prediction; Graph convolution network; Spatial-temporal interaction-aware learning; Time-extrapolator pyramid; Two-dimensional Gaussian distribution; ATTENTION; MODEL;
D O I
10.1007/s11227-023-05850-8
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Accurately predicting the future trajectory of pedestrians is critical for tasks such as autonomous driving and robot navigation. Previous methods for pedestrian trajectory prediction dealt with social interaction and pedestrian movement factors either concurrently or sequentially, neglecting the link between them. Therefore, a spatial-temporal interaction-aware graph convolution network (STIGCN) is proposed for pedestrian trajectory prediction. STIGCN considers the correlation between social interaction and pedestrian movement factors to achieve more accurate interaction modeling. Specifically, we first constructed spatial and temporal graphs to model social interactions and movement factors. Then, we designed the spatial-temporal interaction-aware learning to utilize the spatial interaction features of each moment to assist the temporal interaction modeling and utilize the temporal interaction features of each pedestrian to assist the spatial interaction modeling, resulting in more accurate interaction modeling. Finally, a time-extrapolator pyramid convolution neural network (TEP-CNN) is designed to jointly estimate the two-dimensional Gaussian distribution parameters of future trajectories by combining the prediction features from multiple layers. Experimental results on two benchmark pedestrian trajectory prediction datasets show that our proposed method outperforms existing methods in terms of average displacement error and final displacement error and achieves more accurate predictions for pedestrian motions such as convergence and encounter.
引用
收藏
页码:10695 / 10719
页数:25
相关论文
共 52 条
[1]   PreTR: Spatio-Temporal Non-Autoregressive Trajectory Prediction Transformer [J].
Achaji, Lina ;
Barry, Thierno ;
Fouqueray, Thibault ;
Moreau, Julien ;
Aioun, Francois ;
Charpillet, Francois .
2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, :2457-2464
[2]   Social LSTM: Human Trajectory Prediction in Crowded Spaces [J].
Alahi, Alexandre ;
Goel, Kratarth ;
Ramanathan, Vignesh ;
Robicquet, Alexandre ;
Li Fei-Fei ;
Savarese, Silvio .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :961-971
[3]  
Bütepage J, 2018, IEEE INT CONF ROBOT, P4563, DOI 10.1109/ICRA.2018.8460651
[4]   Human Trajectory Prediction via Counterfactual Analysis [J].
Chen, Guangyi ;
Li, Junlong ;
Lu, Jiwen ;
Zhou, Jie .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :9804-9813
[5]  
Cui HG, 2019, IEEE INT CONF ROBOT, P2090, DOI [10.1109/icra.2019.8793868, 10.1109/ICRA.2019.8793868]
[6]  
Cunjun Yu, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12357), P507, DOI 10.1007/978-3-030-58610-2_30
[7]   Convolutional Social Pooling for Vehicle Trajectory Prediction [J].
Deo, Nachiket ;
Trivedi, Mohan M. .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :1549-1557
[8]   Soft plus Hardwired attention: An LSTM framework for human trajectory prediction and abnormal event detection [J].
Fernando, Tharindu ;
Denman, Simon ;
Sridharan, Sridha ;
Fookes, Clinton .
NEURAL NETWORKS, 2018, 108 :466-478
[9]   Transformer Networks for Trajectory Forecasting [J].
Giuliari, Francesco ;
Hasan, Irtiza ;
Cristani, Marco ;
Galasso, Fabio .
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, :10335-10342
[10]   Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks [J].
Gupta, Agrim ;
Johnson, Justin ;
Li Fei-Fei ;
Savarese, Silvio ;
Alahi, Alexandre .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2255-2264