Trajectory Distribution Aware Graph Convolutional Network for Trajectory Prediction Considering Spatio-Temporal Interactions and Scene Information

被引:9
作者
Wang, Ruiping [1 ]
Hu, Zhijian [2 ]
Song, Xiao [3 ]
Li, Wenxin [3 ]
机构
[1] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[2] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
[3] Beihang Univ, Sch Cyber Sci & Technol, Beijing 100191, Peoples R China
基金
北京市自然科学基金;
关键词
Trajectory; Pedestrians; Predictive models; Heating systems; Directed graphs; Convolution; Visualization; Pedestrian trajectories; graph convolution; multi-head self-attention; trajectory multimodality; trajectory heatmap; MODEL;
D O I
10.1109/TKDE.2023.3329676
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Pedestrian trajectory prediction has been broadly applied in video surveillance and autonomous driving. Most of the current trajectory prediction approaches are committed to improving the prediction accuracy. However, these works remain drawbacks in several aspects, complex interaction modeling among pedestrians, the interactions between pedestrians and environment and the multimodality of pedestrian trajectories. To address the above issues, we propose one new trajectory distribution aware graph convolutional network to improve trajectory prediction performance. First, we propose a novel directed graph and combine multi-head self-attention and graph convolution to capture the spatial interactions. Then, to capture the interactions between pedestrian and environment, we construct a trajectory heatmap, which can reflect the walkable area of the scene and the motion trends of the pedestrian in the scene. Besides, we devise one trajectory distribution-aware module to perceive the distribution information of pedestrian trajectory, aiming at providing rich trajectory information for multi-modal trajectory prediction. Experimental results validate the proposed model can achieve superior trajectory prediction accuracy on the ETH & UCY, SSD, and NBA datasets in terms of both the final displacement error and average displacement error metrics.
引用
收藏
页码:4304 / 4316
页数:13
相关论文
共 48 条
[1]   Bayesian Intent Prediction in Object Tracking Using Bridging Distributions [J].
Ahmad, Bashar I. ;
Murphy, James K. ;
Langdon, Patrick M. ;
Godsill, Simon J. .
IEEE TRANSACTIONS ON CYBERNETICS, 2018, 48 (01) :215-227
[2]   Social Ways: Learning Multi-Modal Distributions of Pedestrian Trajectories with GANs [J].
Amirian, Javad ;
Hayet, Jean-Bernard ;
Pettre, Julien .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, :2964-2972
[3]  
[Anonymous], 2016, About Us
[4]  
Best G, 2015, IEEE INT C INT ROBOT, P5817, DOI 10.1109/IROS.2015.7354203
[5]   Accurate and Diverse Sampling of Sequences based on a "Best of Many" Sample Objective [J].
Bhattacharyya, Apratim ;
Schiele, Bernt ;
Fritz, Mario .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8485-8493
[6]   Personalized Trajectory Prediction via Distribution Discrimination [J].
Chen, Guangyi ;
Li, Junlong ;
Zhou, Nuoxing ;
Ren, Liangliang ;
Lu, Jiwen .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :15560-15569
[7]   Pedestrian Trajectory Prediction in Heterogeneous Traffic Using Pose Keypoints-Based Convolutional Encoder-Decoder Network [J].
Chen, Kai ;
Song, Xiao ;
Ren, Xiaoxiang .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (05) :1764-1775
[8]  
Ellis David, 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops, P1229, DOI 10.1109/ICCVW.2009.5457470
[9]  
Gao X. Shi, 2022, arXiv
[10]   Deep Context Maps: Agent Trajectory Prediction Using Location-Specific Latent Maps [J].
Gilitschenski, Igor ;
Rosman, Guy ;
Gupta, Arjun ;
Karaman, Sertac ;
Rus, Daniela .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (04) :5097-5104