Trajectory Distribution Aware Graph Convolutional Network for Trajectory Prediction Considering Spatio-Temporal Interactions and Scene Information

被引:4
作者
Wang, Ruiping [1 ]
Hu, Zhijian [2 ]
Song, Xiao [3 ]
Li, Wenxin [3 ]
机构
[1] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[2] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
[3] Beihang Univ, Sch Cyber Sci & Technol, Beijing 100191, Peoples R China
基金
北京市自然科学基金;
关键词
Trajectory; Pedestrians; Predictive models; Heating systems; Directed graphs; Convolution; Visualization; Pedestrian trajectories; graph convolution; multi-head self-attention; trajectory multimodality; trajectory heatmap; MODEL;
D O I
10.1109/TKDE.2023.3329676
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Pedestrian trajectory prediction has been broadly applied in video surveillance and autonomous driving. Most of the current trajectory prediction approaches are committed to improving the prediction accuracy. However, these works remain drawbacks in several aspects, complex interaction modeling among pedestrians, the interactions between pedestrians and environment and the multimodality of pedestrian trajectories. To address the above issues, we propose one new trajectory distribution aware graph convolutional network to improve trajectory prediction performance. First, we propose a novel directed graph and combine multi-head self-attention and graph convolution to capture the spatial interactions. Then, to capture the interactions between pedestrian and environment, we construct a trajectory heatmap, which can reflect the walkable area of the scene and the motion trends of the pedestrian in the scene. Besides, we devise one trajectory distribution-aware module to perceive the distribution information of pedestrian trajectory, aiming at providing rich trajectory information for multi-modal trajectory prediction. Experimental results validate the proposed model can achieve superior trajectory prediction accuracy on the ETH & UCY, SSD, and NBA datasets in terms of both the final displacement error and average displacement error metrics.
引用
收藏
页码:4304 / 4316
页数:13
相关论文
共 49 条
  • [1] Bayesian Intent Prediction in Object Tracking Using Bridging Distributions
    Ahmad, Bashar I.
    Murphy, James K.
    Langdon, Patrick M.
    Godsill, Simon J.
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2018, 48 (01) : 215 - 227
  • [2] Social Ways: Learning Multi-Modal Distributions of Pedestrian Trajectories with GANs
    Amirian, Javad
    Hayet, Jean-Bernard
    Pettre, Julien
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 2964 - 2972
  • [3] [Anonymous], 2016, About Us
  • [4] Best G, 2015, IEEE INT C INT ROBOT, P5817, DOI 10.1109/IROS.2015.7354203
  • [5] Accurate and Diverse Sampling of Sequences based on a "Best of Many" Sample Objective
    Bhattacharyya, Apratim
    Schiele, Bernt
    Fritz, Mario
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8485 - 8493
  • [6] Personalized Trajectory Prediction via Distribution Discrimination
    Chen, Guangyi
    Li, Junlong
    Zhou, Nuoxing
    Ren, Liangliang
    Lu, Jiwen
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 15560 - 15569
  • [7] Pedestrian Trajectory Prediction in Heterogeneous Traffic Using Pose Keypoints-Based Convolutional Encoder-Decoder Network
    Chen, Kai
    Song, Xiao
    Ren, Xiaoxiang
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (05) : 1764 - 1775
  • [8] Cunjun Yu, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12357), P507, DOI 10.1007/978-3-030-58610-2_30
  • [9] Ellis David, 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops, P1229, DOI 10.1109/ICCVW.2009.5457470
  • [10] Gao JS, 2022, Arxiv, DOI arXiv:2202.03954