Driver Intent-Based Intersection Autonomous Driving Collision Avoidance Reinforcement Learning Algorithm

被引:1
|
作者
Chen, Ting [1 ]
Chen, Youjing [1 ]
Li, Hao [2 ]
Gao, Tao [1 ]
Tu, Huizhao [2 ]
Li, Siyu [1 ]
机构
[1] Changan Univ, Sch Informat Engn, Xian 710064, Peoples R China
[2] Tongji Univ, Coll Transportat Engn, Key Lab Rd, Traff Engn Minist Educ, Shanghai 201804, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
self-driving vehicles; latent states; variational autoencoder; deep reinforcement learning; INFORMATION; MODEL;
D O I
10.3390/s22249943
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
With the rapid development of artificial intelligent technology, the deep learning method is widely applied to predict human driving intentions due to its relative accuracy of prediction, which is one of critical links for security guarantee in the distributed, mixed driving scenario. In order to sense the intention of human-driven vehicles and reduce the self-driving collision avoidance rate, an improved intention prediction method for human-driving vehicles based on unsupervised, deep inverse reinforcement learning is proposed. Firstly, a contrast discriminator module was proposed to extract richer features. Then, the residual module was created to overcome the drawbacks of gradient disappearance and network degradation with the increase in network layers. Furthermore, the dropout layer was generated to prevent the over-fitting phenomenon in the whole training process of the GRU network, so as to improve the generalization ability of the network model. Finally, abundant experiments were conducted on datasets to evaluate our proposed method. The pass rate of self-driving vehicles with conservative driver probabilities of p = 0.25, p = 0.4, and p = 0.6 improved by a maximum of 8%, 10%, and 3%, compared with the classical method LSTM and VAE + RNN. It indicates that the prediction results of our proposed method fit more with the basic structure of the given traffic scenario in a long-term prediction range, which verifies the effectiveness of our proposed method.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Deep reinforcement learning for collision avoidance of autonomous ships in inland river
    Zhang, Xiuxia
    Sun, Tingting
    PROCEEDINGS OF THE INSTITUTION OF CIVIL ENGINEERS-TRANSPORT, 2024,
  • [22] Deep-reinforcement-learning-based UAV autonomous navigation and collision avoidance in unknown environments
    Fei WANG
    Xiaoping ZHU
    Zhou ZHOU
    Yang TANG
    Chinese Journal of Aeronautics, 2024, 37 (03) : 237 - 257
  • [23] CONTROL METHOD FOR PATH FOLLOWING AND COLLISION AVOIDANCE OF AUTONOMOUS SHIP BASED ON DEEP REINFORCEMENT LEARNING
    Zhao, Luman
    Roh, Myung-Il
    Lee, Sung-Jun
    JOURNAL OF MARINE SCIENCE AND TECHNOLOGY-TAIWAN, 2019, 27 (04): : 293 - 310
  • [24] Autonomous spacecraft collision avoidance with a variable number of space debris based on safe reinforcement learning
    Mu, Chaoxu
    Liu, Shuo
    Lu, Ming
    Liu, Zhaoyang
    Cui, Lei
    Wang, Ke
    AEROSPACE SCIENCE AND TECHNOLOGY, 2024, 149
  • [25] A Comparative Study of Reinforcement Learning-based Collision Avoidance for Maritime Autonomous Surface Ships
    Zhao, Liangbin
    Yu, Xingrui
    Fu, Xiuju
    2024 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI 2024, 2024, : 15 - 18
  • [26] Deep-reinforcement-learning-based UAV autonomous navigation and collision avoidance in unknown environments
    Wang, Fei
    Zhu, Xiaoping
    Zhou, Zhou
    Tang, Yang
    CHINESE JOURNAL OF AERONAUTICS, 2024, 37 (03) : 237 - 257
  • [27] A Prioritized Collision Avoidance Methodology for Autonomous Driving
    Shahriari, Mohammadali
    Biglarbegian, Mohammad
    2016 IEEE 19TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2016, : 1832 - 1837
  • [28] A Collision Avoidance Method Based on Deep Reinforcement Learning
    Feng, Shumin
    Sebastian, Bijo
    Ben-Tzvi, Pinhas
    ROBOTICS, 2021, 10 (02)
  • [29] A Novel Reinforcement Learning Collision Avoidance Algorithm for USVs Based on Maneuvering Characteristics and COLREGs
    Fan, Yunsheng
    Sun, Zhe
    Wang, Guofeng
    SENSORS, 2022, 22 (06)
  • [30] A novel intelligent collision avoidance algorithm based on deep reinforcement learning approach for USV
    Fan, Yunsheng
    Sun, Zhe
    Wang, Guofeng
    OCEAN ENGINEERING, 2023, 287