SSAGCN: Social Soft Attention Graph Convolution Network for Pedestrian Trajectory Prediction

被引:23
作者
Lv, Pei [1 ]
Wang, Wentong [2 ]
Wang, Yunxin [2 ]
Zhang, Yuzhen [1 ]
Xu, Mingliang [1 ]
Xu, Changsheng [3 ,4 ]
机构
[1] Zhengzhou Univ, Sch Comp & Artificial Intelligence, Zhengzhou, Peoples R China
[2] Zhengzhou Univ, Henan Inst Adv Technol, Zhengzhou 450003, Peoples R China
[3] Chinese Acad Sci, Inst Automat, NLPR, Beijing, Peoples R China
[4] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
Trajectory; Predictive models; Task analysis; Convolution; Autonomous vehicles; Convolutional neural networks; Social factors; Graph convolutional network (GCN); social and scene interactions; social soft attention; trajectory prediction;
D O I
10.1109/TNNLS.2023.3250485
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Pedestrian trajectory prediction is an important technique of autonomous driving. In order to accurately predict the reasonable future trajectory of pedestrians, it is inevitable to consider social interactions among pedestrians and the influence of surrounding scene simultaneously, which can fully represent the complex behavior information and ensure the rationality of predicted trajectories obeyed realistic rules. In this article, we propose one new prediction model named social soft attention graph convolution network (SSAGCN), which aims to simultaneously handle social interactions among pedestrians and scene interactions between pedestrians and environments. In detail, when modeling social interaction, we propose a new social soft attention function, which fully considers various interaction factors among pedestrians. Also, it can distinguish the influence of pedestrians around the agent based on different factors under various situations. For the scene interaction, we propose one new sequential scene sharing mechanism. The influence of the scene on one agent at each moment can be shared with other neighbors through social soft attention; therefore, the influence of the scene is expanded both in spatial and temporal dimensions. With the help of these improvements, we successfully obtain socially and physically acceptable predicted trajectories. The experiments on public available datasets prove the effectiveness of SSAGCN and have achieved state-of-the-art results. The project code is available at.
引用
收藏
页码:11989 / 12003
页数:15
相关论文
共 58 条
  • [1] Social LSTM: Human Trajectory Prediction in Crowded Spaces
    Alahi, Alexandre
    Goel, Kratarth
    Ramanathan, Vignesh
    Robicquet, Alexandre
    Li Fei-Fei
    Savarese, Silvio
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 961 - 971
  • [2] Social Ways: Learning Multi-Modal Distributions of Pedestrian Trajectories with GANs
    Amirian, Javad
    Hayet, Jean-Bernard
    Pettre, Julien
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 2964 - 2972
  • [3] Bahdanau D, 2016, Arxiv, DOI arXiv:1409.0473
  • [4] Bai HY, 2015, IEEE INT CONF ROBOT, P454, DOI 10.1109/ICRA.2015.7139219
  • [5] Bai Shaojie, 2018, ARXIV
  • [6] Cunjun Yu, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12357), P507, DOI 10.1007/978-3-030-58610-2_30
  • [7] TPNet: Trajectory Proposal Network for Motion Prediction
    Fang, Liangji
    Jiang, Qinhong
    Shi, Jianping
    Zhou, Bolei
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 6796 - 6805
  • [8] Graph Convolutional Tracking
    Gao, Junyu
    Zhang, Tianzhu
    Xu, Changsheng
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 4644 - 4654
  • [9] A survey of deep learning techniques for autonomous driving
    Grigorescu, Sorin
    Trasnea, Bogdan
    Cocias, Tiberiu
    Macesanu, Gigel
    [J]. JOURNAL OF FIELD ROBOTICS, 2020, 37 (03) : 362 - 386
  • [10] A Survey on Motion Prediction of Pedestrians and Vehicles for Autonomous Driving
    Gulzar, Mahir
    Muhammad, Yar
    Muhammad, Naveed
    [J]. IEEE ACCESS, 2021, 9 : 137957 - 137969