Trajectory Prediction with Attention-Based Spatial-Temporal Graph Convolutional Networks for Autonomous Driving

被引:2
|
作者
Li, Hongbo [1 ,2 ]
Ren, Yilong [1 ,2 ]
Li, Kaixuan [1 ]
Chao, Wenjie [1 ]
机构
[1] Beihang Univ, Sch Transportat Sci & Engn, Beijing 100191, Peoples R China
[2] Zhongguancun Lab, Beijing 100094, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 23期
关键词
autonomous vehicle; trajectory prediction; intersection scene; graph convolutional networks; NGSIM; NEURAL-NETWORKS; INTERSECTIONS;
D O I
10.3390/app132312580
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Accurate and reliable trajectory prediction is crucial for autonomous vehicles to achieve safe and efficient operation. Vehicles perceive the historical trajectories of moving objects and make predictions of behavioral intentions for a future period of time. With the predicted trajectories of moving objects such as obstacle vehicles, pedestrians, and non-motorized vehicles as inputs, self-driving vehicles can make more rational driving decisions and plan more reasonable and safe vehicle motion behaviors. However, due to traffic environments such as intersection scenes with highly interdependent and dynamic attributes, the task of motion anticipation becomes challenging. Existing works focus on the mutual relationships among vehicles while ignoring other potential essential interactions such as vehicle-traffic rules. These studies have not yet deeply explored the intensive learning of interactions between multi-agents, which may result in evaluation deviations. Aiming to meet these issues, we have designed a novel framework, namely trajectory prediction with attention-based spatial-temporal graph convolutional networks (TPASTGCN). In our proposal, the multi-agent interaction mechanisms, including vehicle-vehicle and vehicle-traffic rules, are meticulously highlighted and integrated into one homogeneous graph by transferring the time-series data of traffic lights into the spatial-temporal domains. Through integrating the attention mechanism into the adjacency matrix, we effectively learn the different strengths of interactive association and improve the model's ability to capture critical features. Simultaneously, we construct a hierarchical structure employing the spatial GCN and temporal GCN to extract the spatial dependencies of traffic networks. Profiting from the gated recurrent unit (GRU), the scene context in temporal dimensions is further attained and enhanced with the encoder. In such a way, the GCN and GRU networks are fused as a features extractor module in the proposed framework. Finally, the future potential trajectories generation tasks are performed by another GRU network. Experiments on real-world datasets demonstrate the superior performance of the scheme compared with several baselines.
引用
收藏
页数:19
相关论文
共 50 条
  • [31] Traffic Flow Prediction Using Novel Spatial-Temporal Multi-Head Attention Graph Convolution Networks
    Cheng, Yuan
    Peng, Cheng
    Wang, Ze
    Liu, Baiqi
    Feng, Jiandong
    Li, Ao
    TRANSPORTATION RESEARCH RECORD, 2024,
  • [32] Semantics-STGCNN: A Semantics-guided Spatial-Temporal Graph Convolutional Network for Multi-class Trajectory Prediction
    Rainbow, Ben A.
    Men, Qianhui
    Shum, Hubert P. H.
    2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 2959 - 2966
  • [33] A Spatial-Temporal Attention Approach for Traffic Prediction
    Shi, Xiaoming
    Qi, Heng
    Shen, Yanming
    Wu, Genze
    Yin, Baocai
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (08) : 4909 - 4918
  • [34] Normal graph: Spatial temporal graph convolutional networks based prediction network for skeleton based video anomaly detection
    Luo, Weixin
    Liu, Wen
    Gao, Shenghua
    NEUROCOMPUTING, 2021, 444 : 332 - 337
  • [35] GATraj: A graph- and attention-based multi-agent trajectory prediction model
    Cheng, Hao
    Liu, Mengmeng
    Chen, Lin
    Broszio, Hellward
    Sester, Monika
    Yang, Michael Ying
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 205 : 163 - 175
  • [36] HYPERBOLIC SPATIAL TEMPORAL GRAPH CONVOLUTIONAL NETWORKS
    Mostafa, Abdelrahman
    Peng, Wei
    Zhao, Guoying
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 3301 - 3305
  • [37] ST CrossingPose: A Spatial-Temporal Graph Convolutional Network for Skeleton-Based Pedestrian Crossing Intention Prediction
    Zhang, Xingchen
    Angeloudis, Panagiotis
    Demiris, Yiannis
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) : 20773 - 20782
  • [38] Fault Prediction for Electromechanical Equipment Based on Spatial-Temporal Graph Information
    Zhang, Xiaofei
    Long, Zhuo
    Peng, Jian
    Wu, Gongping
    Hu, Haifeng
    Lyu, MingCheng
    Qin, Guojun
    Song, Dianyi
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (02) : 1413 - 1424
  • [39] Improved spatial-temporal graph convolutional networks for upper limb rehabilitation assessment based on precise posture measurement
    Bai, Jing
    Wang, Zhixian
    Lu, Xuanming
    Wen, Xiulan
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [40] ESTS-GCN: An Ensemble Spatial-Temporal Skeleton-Based Graph Convolutional Networks for Violence Detection
    Janbi, Nourah Fahad
    Ghaseb, Musrea Abdo
    Almazroi, Abdulwahab Ali
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2024, 2024