Deep learning-based vehicle trajectory prediction based on generative adversarial network for autonomous driving applications

被引:8
|
作者
Hsu, Chih-Chung [1 ]
Kang, Li-Wei [2 ]
Chen, Shih-Yu [3 ]
Wang, I-Shan [3 ]
Hong, Ching-Hao [4 ]
Chang, Chuan-Yu [3 ]
机构
[1] Natl Cheng Kung Univ, Inst Data Sci, Tainan, Taiwan
[2] Natl Taiwan Normal Univ, Dept Elect Engn, Taipei, Taiwan
[3] Natl Yunlin Univ Sci & Technol, Dept Comp Sci & Informat Engn, Touliu, Yunlin, Taiwan
[4] Natl Pingtung Univ Sci & Technol, Dept Management Informat Syst, Pingtung, Taiwan
关键词
Autonomous vehicles; Self-driving cars; Vehicle trajectory; Deep learning; Generative adversarial networks; Deep social learning networks; BEHAVIOR;
D O I
10.1007/s11042-022-13742-x
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Autonomous vehicles need to continuously navigate complex traffic environments by efficiently analyzing the surrounding scene, understanding the behavior of other traffic agents, and predicting their future trajectories. The primary objective is to draw up a safe motion and reduce the reaction time for possibly imminent hazards. The main problem addressed in this paper is to explore the movement patterns of surrounding traffic-agents and accurately predict their future trajectories for assisting the vehicle to make a reasonable decision. Traditional trajectory prediction modules require explicit coordinate information to model the interaction between the autonomous car and its surrounding vehicles. However, it is hard to know the real coordinate of surrounding vehicles in real-world scenarios without communications between vehicles. A GAN (generative adversarial network)-based deep learning framework is presented in this paper for predicting the trajectories of surrounding vehicles of an autonomous vehicle in an RGB image sequence without explicit coordinate annotation to solve this problem. To automatically predict the trajectory from RGB image sequences, a coordinate augmentation module and a coordinate stabilization module are proposed to extract the historical trajectory from an image sequence. Meanwhile, the self-attention mechanism is also proposed to improve the social pooling module for better capturing the context information of trajectories of surrounding vehicles. Experimental results are demonstrated that the proposed method is effective and efficient.
引用
收藏
页码:10763 / 10780
页数:18
相关论文
共 50 条
  • [21] Deep Learning-Based Motion Prediction Leveraging Autonomous Driving Datasets: State-of-the-Art
    Barrios, Fernando A.
    Biswas, Atriya
    Emadi, Ali
    IEEE ACCESS, 2024, 12 : 93318 - 93332
  • [22] Design of robust deep learning-based object detection and classification model for autonomous driving applications
    Mesfer Al Duhayyim
    Fahd N. Al-Wesabi
    Anwer Mustafa Hilal
    Manar Ahmed Hamza
    Shalini Goel
    Deepak Gupta
    Ashish Khanna
    Soft Computing, 2022, 26 : 7641 - 7652
  • [23] The analysis of generative adversarial network in sports education based on deep learning
    Eerdenisuyila, Eerdenisuyila
    Li, Hongming
    Chen, Wei
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [24] Design of robust deep learning-based object detection and classification model for autonomous driving applications
    Al Duhayyim, Mesfer
    Al-Wesabi, Fahd N.
    Hilal, Anwer Mustafa
    Hamza, Manar Ahmed
    Goel, Shalini
    Gupta, Deepak
    Khanna, Ashish
    SOFT COMPUTING, 2022, 26 (16) : 7641 - 7652
  • [25] Deep Learning-Based Multimodal Trajectory Prediction with Traffic Light
    Lee, Seoyoung
    Park, Hyogyeong
    You, Yeonhwi
    Yong, Sungjung
    Moon, Il-Young
    APPLIED SCIENCES-BASEL, 2023, 13 (22):
  • [26] Learning-Based Fast Electromagnetic Scattering Solver Through Generative Adversarial Network
    Ma, Zhenchao
    Xu, Kuiwen
    Song, Rencheng
    Wang, Chao-Fu
    Chen, Xudong
    IEEE TRANSACTIONS ON ANTENNAS AND PROPAGATION, 2021, 69 (04) : 2194 - 2208
  • [27] Deep Learning Based Autonomous Vehicle Super Resolution DOA Estimation for Safety Driving
    Wan, Liangtian
    Sun, Yuchen
    Sun, Lu
    Ning, Zhaolong
    Rodrigues, Joel J. P. C.
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (07) : 4301 - 4315
  • [28] Deep learning-based perception systems for autonomous driving: A comprehensive survey
    Wen, Li-Hua
    Jo, Kang-Hyun
    NEUROCOMPUTING, 2022, 489 : 255 - 270
  • [29] Deep Learning-Based Defect Prediction for Mobile Applications
    Jorayeva, Manzura
    Akbulut, Akhan
    Catal, Cagatay
    Mishra, Alok
    SENSORS, 2022, 22 (13)
  • [30] Deep Learning-Based Traffic Prediction for Network Optimization
    Troia, Sebastian
    Alvizu, Rodolfo
    Zhou, Youduo
    Maier, Guido
    Pattavina, Achille
    2018 20TH ANNIVERSARY INTERNATIONAL CONFERENCE ON TRANSPARENT OPTICAL NETWORKS (ICTON), 2018,