Driver Intent-Based Intersection Autonomous Driving Collision Avoidance Reinforcement Learning Algorithm

被引:1
|
作者
Chen, Ting [1 ]
Chen, Youjing [1 ]
Li, Hao [2 ]
Gao, Tao [1 ]
Tu, Huizhao [2 ]
Li, Siyu [1 ]
机构
[1] Changan Univ, Sch Informat Engn, Xian 710064, Peoples R China
[2] Tongji Univ, Coll Transportat Engn, Key Lab Rd, Traff Engn Minist Educ, Shanghai 201804, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
self-driving vehicles; latent states; variational autoencoder; deep reinforcement learning; INFORMATION; MODEL;
D O I
10.3390/s22249943
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
With the rapid development of artificial intelligent technology, the deep learning method is widely applied to predict human driving intentions due to its relative accuracy of prediction, which is one of critical links for security guarantee in the distributed, mixed driving scenario. In order to sense the intention of human-driven vehicles and reduce the self-driving collision avoidance rate, an improved intention prediction method for human-driving vehicles based on unsupervised, deep inverse reinforcement learning is proposed. Firstly, a contrast discriminator module was proposed to extract richer features. Then, the residual module was created to overcome the drawbacks of gradient disappearance and network degradation with the increase in network layers. Furthermore, the dropout layer was generated to prevent the over-fitting phenomenon in the whole training process of the GRU network, so as to improve the generalization ability of the network model. Finally, abundant experiments were conducted on datasets to evaluate our proposed method. The pass rate of self-driving vehicles with conservative driver probabilities of p = 0.25, p = 0.4, and p = 0.6 improved by a maximum of 8%, 10%, and 3%, compared with the classical method LSTM and VAE + RNN. It indicates that the prediction results of our proposed method fit more with the basic structure of the given traffic scenario in a long-term prediction range, which verifies the effectiveness of our proposed method.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Research on Collision Avoidance Algorithm of Unmanned Surface Vehicle Based on Deep Reinforcement Learning
    Xia, Jiawei
    Zhu, Xufang
    Liu, Zhikun
    Luo, Yasong
    Wu, Zhaodong
    Wu, Qiuhan
    IEEE SENSORS JOURNAL, 2023, 23 (11) : 11262 - 11273
  • [32] Training Is Execution: A Reinforcement Learning-Based Collision Avoidance Algorithm for Volatile Scenarios
    Ban, Jian
    Li, Gongyan
    IEEE ACCESS, 2024, 12 : 116956 - 116967
  • [33] A forward collision avoidance algorithm based on driver braking behavior
    Xiong, Xiaoxia
    Wang, Meng
    Cai, Yingfeng
    Chen, Long
    Farah, Haneen
    Hagenzieker, Marjan
    ACCIDENT ANALYSIS AND PREVENTION, 2019, 129 : 30 - 43
  • [34] Adversarial Reinforcement Learning Framework for Benchmarking Collision Avoidance Mechanisms in Autonomous Vehicles
    Behzadan, Vahid
    Munir, Arslan
    IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE, 2021, 13 (02) : 236 - 241
  • [35] Deep reinforcement learning with predictive auxiliary task for autonomous train collision avoidance
    Plissonneau, Antoine
    Jourdan, Luca
    Trentesaux, Damien
    Abdi, Lotfi
    Sallak, Mohamed
    Bekrar, Abdelghani
    Quost, Benjamin
    Schoen, Walter
    JOURNAL OF RAIL TRANSPORT PLANNING & MANAGEMENT, 2024, 31
  • [36] Intent-based Deep Reinforcement Learning for Multi-agent Informative Path Planning
    Yang, Tianze
    Cao, Yuhong
    Sartoretti, Guillaume
    2023 INTERNATIONAL SYMPOSIUM ON MULTI-ROBOT AND MULTI-AGENT SYSTEMS, MRS, 2023, : 71 - 77
  • [37] Autonomous Obstacle Avoidance Algorithm for Unmanned Aerial Vehicles Based on Deep Reinforcement Learning
    Gao, Yuan
    Ren, Ling
    Shi, Tianwei
    Xu, Teng
    Ding, Jianbang
    ENGINEERING LETTERS, 2024, 32 (03) : 650 - 660
  • [38] Intent-based multi-agent reinforcement learning for service assurance in cellular networks
    Perepu, Satheesh K.
    Martins, Jean P.
    Souza, Ricardo S.
    Dey, Kaushik
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 2879 - 2884
  • [39] Intersection Collision Avoidance: From Driver Alerts to Vehicle Control
    Maile, M.
    Chen, Q.
    Brown, G.
    Delgrossi, L.
    2015 IEEE 81ST VEHICULAR TECHNOLOGY CONFERENCE (VTC SPRING), 2015,
  • [40] LossLeaP: Learning to Predict for Intent-Based Networking
    Collet, Alan
    Banchs, Albert
    Fiore, Marco
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2022), 2022, : 2138 - 2147