An Improved Multimodal Trajectory Prediction Method Based on Deep Inverse Reinforcement Learning

被引:4
|
作者
Chen, Ting [1 ]
Guo, Changxin [1 ]
Li, Hao [2 ]
Gao, Tao [1 ]
Chen, Lei [3 ]
Tu, Huizhao [2 ]
Yang, Jiangtian [1 ]
机构
[1] Changan Univ, Sch Informat Engn, Xian 710064, Peoples R China
[2] Tongji Univ, Coll Transportat Engn, Key Lab Rd & Traff Engn Minist Educ, Shanghai 201804, Peoples R China
[3] RISE Res Inst Sweden AB, S-41756 Gothenburg, Sweden
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
multimodal trajectory prediction; rasterization; dilated convolution; maximum entropy inverse reinforcement learning (MaxEnt RL);
D O I
10.3390/electronics11244097
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid development of artificial intelligence technology, the deep learning method has been introduced for vehicle trajectory prediction in the internet of vehicles, since it provides relative accurate prediction results, which is one of the critical links to guarantee security in the distributed mixed-driving scenario. In order to further enhance prediction accuracy by making full utilization of complex traffic scenes, an improved multimodal trajectory prediction method based on deep inverse reinforcement learning is proposed. Firstly, a fused dilated convolution module for better extracting raster features is introduced into the existing multimodal trajectory prediction network backbone. Then, a reward update policy with inferred goals is improved by learning the state rewards of goals and paths separately instead of original complex rewards, which can reduce the requirement for predefined goal states. Furthermore, a correction factor is introduced in the existing trajectory generator module, which can better generate diverse trajectories by penalizing trajectories with little difference. Abundant experiments on the current popular public dataset indicate that the prediction results of our proposed method are a better fit with the basic structure of the given traffic scenario in a long-term prediction range, which verifies the effectiveness of our proposed method.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Multimodal Vehicular Trajectory Prediction With Inverse Reinforcement Learning and Risk Aversion at Urban Unsignalized Intersections
    Geng, Maosi
    Cai, Zeen
    Zhu, Yizhang
    Chen, Xiqun
    Lee, Der-Horng
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (11) : 12227 - 12240
  • [2] Deep Learning-Based Multimodal Trajectory Prediction with Traffic Light
    Lee, Seoyoung
    Park, Hyogyeong
    You, Yeonhwi
    Yong, Sungjung
    Moon, Il-Young
    APPLIED SCIENCES-BASEL, 2023, 13 (22):
  • [3] Vehicle Trajectory Prediction Model Based on Attention Mechanism and Inverse Reinforcement Learning
    Lu, Liping
    Ning, Qinjian
    Qiu, Yujie
    Chu, Duanfeng
    2022 IEEE 34TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2022, : 1160 - 1166
  • [4] Trajectory Jerking Suppression for Mixed Traffic Flow at a Signalized Intersection: A Trajectory Prediction Based Deep Reinforcement Learning Method
    Wang, Shupei
    Wang, Ziyang
    Jiang, Rui
    Yan, Ruidong
    Du, Lei
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) : 18989 - 19000
  • [5] IRLSOT: Inverse reinforcement learning for scene-oriented trajectory prediction
    He, Caizhen
    Chen, Lanping
    Xu, Liming
    Yang, Changchun
    Liu, Xiaofeng
    Yang, Biao
    IET INTELLIGENT TRANSPORT SYSTEMS, 2022, 16 (06) : 769 - 781
  • [6] Deep reinforcement learning-based reactive trajectory planning method for UAVs
    Cao, Lijia
    Wang, Lin
    Liu, Yang
    Xu, Weihong
    Geng, Chuang
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART G-JOURNAL OF AEROSPACE ENGINEERING, 2024, 238 (10) : 1018 - 1037
  • [7] Research on Trajectory Prediction of Vehicle Lane Change for Autonomous Driving Based on Inverse Reinforcement Learning
    Zhan, Ming
    Fan, Jingjing
    Jin, Linhao
    SEVENTH INTERNATIONAL CONFERENCE ON TRAFFIC ENGINEERING AND TRANSPORTATION SYSTEM, ICTETS 2023, 2024, 13064
  • [8] A novel inverse design method for morphing airfoil based on deep reinforcement learning
    Su, Jing
    Sun, Gang
    Tao, Jun
    AEROSPACE SCIENCE AND TECHNOLOGY, 2024, 145
  • [9] Improved Robot Path Planning Method Based on Deep Reinforcement Learning
    Han, Huiyan
    Wang, Jiaqi
    Kuang, Liqun
    Han, Xie
    Xue, Hongxin
    SENSORS, 2023, 23 (12)
  • [10] Reentry trajectory optimization based on Deep Reinforcement Learning
    Gao, Jiashi
    Shi, Xinming
    Cheng, Zhongtao
    Xiong, Jizhang
    Liu, Lei
    Wang, Yongji
    Yang, Ye
    PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 2588 - 2592