Probabilistic multi-modal expected trajectory prediction based on LSTM for autonomous driving

被引:6
作者
Gao, Zhenhai [1 ]
Bao, Mingxi [1 ]
Gao, Fei [1 ,2 ]
Tang, Minghong [1 ]
机构
[1] Jilin Univ, Sch Vehicle Engn, State Key Lab Automot Simulat & Control, Changchun, Peoples R China
[2] Jilin Univ, Sch Vehicle Engn, State Key Lab Automot Simulat & Control, 5988 Renmin Rd, Changchun 130022, Peoples R China
基金
中国国家自然科学基金;
关键词
Trajectory prediction; behavioral intent recognition; LSTM; interactive behavior; MODEL;
D O I
10.1177/09544070231167906
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Autonomous vehicles (AVs) need to adequately predict the trajectory space of surrounding vehicles (SVs) in order to make reasonable decision-making and improve driving safety. In this paper, we build the driving behavior intention recognition module and traffic vehicle expected trajectory prediction module by deep learning. On the one hand, the driving behavior intention recognition module identifies the probabilities of lane keeping, left lane changing, right lane changing, left acceleration lane changing, and right acceleration lane changing of the predicted vehicle. On the other hand, the expected trajectory prediction module adopts an encoder-decoder architecture, in which the encoder encodes the historical environment information of the surrounding agents as a context vector, and the decoder and MDN network combine the context vector and the identified driving behavior intention to predict the probability distribution of future trajectories. Additionally, our model produces the multiple behaviors and trajectories that may occur in the next 6 s for the predicted vehicle (PV). The proposed model is trained, validated and tested with the HighD dataset. The experimental results show that the constructed probabilistic multi-modal expected trajectory prediction possesses high accuracy in the intention recognition module with full consideration of interactive information. At the same time, the multi-modal probability distribution generated by the anticipated trajectory prediction model is more consistent with the real trajectories, which significantly improves the trajectory prediction accuracy compared with other approaches and has apparent advantages in predicting long-term domain trajectories.
引用
收藏
页码:2817 / 2828
页数:12
相关论文
共 50 条
  • [21] An Integrated LSTM Prediction Method Based On Multi-scale Trajectory Space
    He, Ming
    Qiu, Gongda
    Shen, Jian
    Cao, Yuting
    Gunasekara, Chamath Dilshan
    PROCEEDINGS 2017 4TH IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR), 2017, : 423 - 429
  • [22] Forward collision warning system using multi-modal trajectory prediction of the intelligent vehicle
    Wu, Xiaodong
    Yan, Liang
    Li, Huanghe
    Su, Chengrui
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2024, 238 (2-3) : 358 - 373
  • [23] Deep Learning Based Trajectory Prediction in Autonomous Driving Tasks: A survey
    Xing, Haolin
    Liu, Wei
    Ning, Zuotao
    Zhao, Qixi
    Cheng, Shuai
    Hu, Jun
    2024 16TH INTERNATIONAL CONFERENCE ON COMPUTER AND AUTOMATION ENGINEERING, ICCAE 2024, 2024, : 556 - 561
  • [24] Multi-modal feature fusion based on multi-layers LSTM for video emotion recognition
    Nie, Weizhi
    Yan, Yan
    Song, Dan
    Wang, Kun
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (11) : 16205 - 16214
  • [25] Multi-modal feature fusion based on multi-layers LSTM for video emotion recognition
    Weizhi Nie
    Yan Yan
    Dan Song
    Kun Wang
    Multimedia Tools and Applications, 2021, 80 : 16205 - 16214
  • [26] Stochastic Non-Autoregressive Transformer-Based Multi-Modal Pedestrian Trajectory Prediction for Intelligent Vehicles
    Chen, Xiaobo
    Zhang, Huanjia
    Deng, Fuwen
    Liang, Jun
    Yang, Jian
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (05) : 3561 - 3574
  • [27] Trajectory prediction of UAV Based on LSTM
    Shu, Peng
    Chen, Chengbin
    Chen, Baihe
    Su, Kaixiong
    Chen, Sifan
    Liu, Hairong
    Huang, Fuchun
    2021 2ND INTERNATIONAL CONFERENCE ON BIG DATA & ARTIFICIAL INTELLIGENCE & SOFTWARE ENGINEERING (ICBASE 2021), 2021, : 448 - 451
  • [28] MSTCNN: multi-modal spatio-temporal convolutional neural network for pedestrian trajectory prediction
    Sang, Haifeng
    Chen, Wangxing
    Wang, Haifeng
    Wang, Jinyu
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (03) : 8533 - 8550
  • [29] Multi-Modal Vehicle Trajectory Prediction by Collaborative Learning of Lane Orientation, Vehicle Interaction, and Intention
    Tian, Wei
    Wang, Songtao
    Wang, Zehan
    Wu, Mingzhi
    Zhou, Sihong
    Bi, Xin
    SENSORS, 2022, 22 (11)
  • [30] Trajectory Prediction Using Video Generation in Autonomous Driving
    Iancu, David-Traian
    Nan, Mihai
    Ghita, Stefania-Alexandra
    Florea, Adina-Magda
    STUDIES IN INFORMATICS AND CONTROL, 2022, 31 (01): : 37 - 48