Pedestrian trajectory prediction algorithm based on graph convolutional network

被引:0
作者
Wang T. [1 ]
Liu Y. [1 ]
Guo J. [2 ]
Jin W. [2 ]
机构
[1] School of Microelectronics, Tianjin University, Tianjin
[2] School of Electrical and Information Engineering, Tianjin University, Tianjin
来源
Harbin Gongye Daxue Xuebao/Journal of Harbin Institute of Technology | 2021年 / 53卷 / 02期
关键词
Graph convolutional network; Interaction model; Long short-term memory; Mutual information; Trajectory prediction;
D O I
10.11918/202006051
中图分类号
学科分类号
摘要
To solve the problem that the pedestrian interaction model is difficult to be effectively constructed in the pedestrian trajectory prediction task, a trajectory prediction algorithm based on graph convolutional network (TP-GCN) was proposed to establish pedestrian interaction and predict future trajectories of pedestrians. First, the long short-term memory was used to extract the trajectory motion features of the trajectory sequences of pedestrians. Then, the pedestrians were considered as the nodes on the graph, and adjacency matrix was built to represent the created interactions. Next, the connection weights between unrelated nodes were screened out according to the blind zone. For trajectory motion features, the graph convolutional network was applied to extract the interactions between the trajectories and increase the extraction of the interaction in each trajectory, and the interaction was then encoded as trajectory interaction features by using long short-term memory. Furthermore, the weights of the graph convolutional network were optimized by the Deep Graph Info method to ensure that the motion pattern of individual accords with those of all the pedestrians in the scene. Finally, the trajectory motion features and trajectory interaction features were decoded using long short-term memory to complete the trajectory prediction. According to the experiment on the public datasets ETH and UCY, the proposed algorithm could make the predictions of pedestrian habits close to the real trajectories based on the interaction model between pedestrians, and the overall prediction accuracy was high. In addition, the ablation experiment and the visualization of the predicted trajectory also verified the effectiveness and interpretability of the algorithm. Copyright ©2021 Journal of Harbin Institute of Technology.All rights reserved.
引用
收藏
页码:53 / 60
页数:7
相关论文
共 20 条
[11]  
VEMULA A, MUELLING K, OH J., Social attention: modeling attention in human crowds, 2018 IEEE International Conference on Robotics and Automation (ICRA), (2018)
[12]  
HUANG Yingfan, BI Huikun, LI Zhaoxin, Et al., STGAT: modeling spatial-temporal interactions for human trajectory prediction, 2019 IEEE/CVF International Conference on Computer Vision (ICCV), (2019)
[13]  
VELICKOVIC P, CUCURULL G, CASANOVA A, Et al., Graph attention networks
[14]  
KOSARAJU V, SADEGHIAN A, MARTIN-MARTIN R, Et al., Social-BiGAT: multimodal trajectory forecasting using Bicycle-GAN and graph attention networks, (1907)
[15]  
MOHAMED A, QIAN Kun, ELHOSEINY M, Et al., Social-STGCNN: a social spatio-temporal graph convolutional neural network for human trajectory prediction, IEEE Conference on Computer Vision and Pattern Recognition, (2020)
[16]  
KIPF T N, WELLING M., Semi-supervised classification with graph convolutional networks
[17]  
VELICKOVIC P, FEDUS W, HAMILTON W L, Et al., Deep Graph Infomax
[18]  
PELLEGRINI S, ESS A, VAN GOOL L., Improving data association by joint modeling of pedestrian trajectories and groupings, European Conference on Computer Vision, (2010)
[19]  
LEAL-TAIXE L, FENZI M, KUZNETSOVA A, Et al., Learning an image-based motion context for multiple people tracking, 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (2014)
[20]  
LIANG Junwei, JIANG Lu, NIEBLES J C, Et al., Peeking into the future: predicting future person activities and locations in videos, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2019)