Regional attention network with data-driven modal representation for multimodal trajectory prediction

被引:12
|
作者
Li, Chao [1 ]
Liu, Zhanwen [1 ]
Yang, Nan [1 ]
Li, Wenqian [1 ]
Zhao, Xiangmo [1 ]
机构
[1] Changan Univ, Sch Informat Engn, Xian 710018, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
prediction; Attention Mechanism; Modal Representation; LSTM; IndexTerms-Multi-modal Trajectory;
D O I
10.1016/j.eswa.2023.120808
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate and reliable prediction of vehicle trajectory is one of the core functions for automated vehicles, and it is a keystone for high-quality local motion planning and decision-making. However, due to the complex intervehicle interaction and the diversity of maneuvering classes, predicting future trajectory accurately is a challenging task. In this paper, we propose a novel regional attention network with data-driven modal representation for multi-modal trajectory prediction (RD-Net). In the encoding phase, we construct the intention-based regional attention mechanism to model complex inter-vehicle interaction more effectively. In the traffic scene, this mechanism can assign attention to different regions guided by the intention of the target vehicle and perform weighted aggregation of inter-vehicle interaction in different regions, which makes it possible to model non-local interaction at a larger range without introducing noise caused by unrelated surrounding vehicles. In the decoding phase, a data-driven method is proposed to learn the individualized future modal representation for each trajectory. This method comprehensively considers the commonality and individuality of the trajectory modes, which can guide the proposed model to predict multi-modal trajectory based on different lateral maneuver classes more accurately. Experimental results on two real-world datasets show that the average performance improvement of RD-Net is greater than 21.00%, with a maximum of 52.48%, compared with the existing state-ofart methods, which quantitatively illustrates the significant advantages of RD-Net. Additionally, various ablation experiments are conducted to evaluate the effectiveness of our proposed network components.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Multimodal Transformer Network for Pedestrian Trajectory Prediction
    Yin, Ziyi
    Liu, Ruijin
    Xiong, Zhiliang
    Yuan, Zejian
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 1259 - 1265
  • [32] Attention in infancy: a data-driven perspective
    Tu, Hsing-Fen
    PERCEPTION, 2022, 51 : 112 - 112
  • [33] Data-Driven Inference of Representation Invariants
    Miltner, Anders
    Padhi, Saswat
    Millstein, Todd
    Walker, David
    PROCEEDINGS OF THE 41ST ACM SIGPLAN CONFERENCE ON PROGRAMMING LANGUAGE DESIGN AND IMPLEMENTATION (PLDI '20), 2020, : 1 - 15
  • [34] A data-driven monitoring scheme for multivariate multimodal data
    Wang, Zhiqiong
    Gong, Renping
    Song, Lisha
    He, Shuguang
    Gao, Yuan
    COMPUTERS & INDUSTRIAL ENGINEERING, 2024, 192
  • [35] Network Traffic Prediction Model in a Data-Driven Digital Twin Network Architecture
    Shin, Hyeju
    Oh, Seungmin
    Isah, Abubakar
    Aliyu, Ibrahim
    Park, Jaehyung
    Kim, Jinsul
    ELECTRONICS, 2023, 12 (18)
  • [36] A Data-Driven Approach for GPS Trajectory Data Cleaning
    Li, Lun
    Chen, Xiaohang
    Liu, Qizhi
    Bao, Zhifeng
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2020), PT I, 2020, 12112 : 3 - 19
  • [37] A Multimodal Data-Driven Framework for Anxiety Screening
    Mo, Haimiao
    Hui, Siu Cheung
    Liao, Xiao
    Li, Yuchen
    Zhang, Wei
    Ding, Shuai
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 13
  • [38] Data-driven network alignment
    Gu, Shawn
    Milenkovic, Tijana
    PLOS ONE, 2020, 15 (07):
  • [39] Multimodal Data-Driven Prediction of PEMFC Performance and Process Conditions Using Deep Learning
    Shin, Seoyoon
    Kim, Jiwon
    Lee, Seokhee
    Shin, Tae Ho
    Ryu, Ga-Ae
    IEEE ACCESS, 2024, 12 : 168030 - 168042
  • [40] Data-driven network loading
    Tsanakas, N.
    Ekstrom, J.
    Gundlegard, D.
    Olstam, J.
    Rydergren, C.
    TRANSPORTMETRICA B-TRANSPORT DYNAMICS, 2021, 9 (01) : 237 - 265