Achieving accurate trajectory predicting and tracking for autonomous vehicles via reinforcement learning-assisted control approaches

被引:4
作者
Tan, Guangwen [1 ]
Li, Mengshan [1 ]
Hou, Biyu [1 ]
Zhu, Jihong [1 ]
Guan, Lixin [1 ]
机构
[1] Gannan Normal Univ, Coll Phys & Elect Informat, Ganzhou 341000, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Autonomous driving; Reinforcement learning; Vehicle lane-change; Tracking control;
D O I
10.1016/j.engappai.2024.108773
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In complex urban traffic scenarios, autonomous vehicles face significant challenges in adapting to diverse and dynamic traffic conditions. Reward-based reinforcement learning has emerged as an effective approach to tackle these challenges. This paper presents a novel method that combines deep reinforcement learning with automotive dynamics systems. Building upon the Double Deep Q-learning algorithm, our approach integrates a Recurrent Neural Network with Gated Recurrent Units to enhance the environmental exploration capabilities of autonomous vehicles. To obtain more precise reward values, we introduce a trajectory tracking algorithm based on a combination of proportional-integral-derivative control and feedforward control within the automotive dynamics system. The proportional-integral-derivative controller is utilized for longitudinal control, while the Error-Optimized feedforward controller enhances lateral control, thereby improving trajectory tracking accuracy. Finally, extensive simulation experiments are conducted to evaluate the proposed method, comparing it against other baseline methods in terms of vehicle following and lane-changing scenarios. The results demonstrate that our approach significantly improves both the reward values and control performance of the algorithm.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Trajectory Tracking Control for Mobile Robots Using Reinforcement Learning and PID
    Wang, Shuti
    Yin, Xunhe
    Li, Peng
    Zhang, Mingzhi
    Wang, Xin
    [J]. IRANIAN JOURNAL OF SCIENCE AND TECHNOLOGY-TRANSACTIONS OF ELECTRICAL ENGINEERING, 2020, 44 (03) : 1059 - 1068
  • [22] Trajectory Tracking Control for Mobile Robots Using Reinforcement Learning and PID
    Shuti Wang
    Xunhe Yin
    Peng Li
    Mingzhi Zhang
    Xin Wang
    [J]. Iranian Journal of Science and Technology, Transactions of Electrical Engineering, 2020, 44 : 1059 - 1068
  • [23] Reinforcement Learning Formation Tracking of Networked Autonomous Surface Vehicles With Bounded Inputs via Cloud-Supported Communication
    Ding, Teng-Fei
    Ge, Ming-Feng
    Liu, Zhi-Wei
    Wang, Leimin
    Liu, Jie
    [J]. IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (01): : 469 - 480
  • [24] Trajectory Planning and Tracking Control of Autonomous Vehicles Based on Improved Artificial Potential Field
    Gao, Yan
    Li, Dazhi
    Sui, Zhen
    Tian, Yantao
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (09) : 12468 - 12483
  • [25] Trajectory tracking control of autonomous vehicles based on Lagrangian neural network dynamics model
    Yang, Wei
    Cai, Yingfeng
    Sun, Xiaoqiang
    He, Youguo
    Yuan, Chaochun
    Wang, Hai
    Chen, Long
    [J]. PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2024, 238 (12) : 3483 - 3498
  • [26] Navigation for autonomous vehicles via fast-stable and smooth reinforcement learning
    RuiXian Zhang
    JiaNan Yang
    Ye Liang
    ShengAo Lu
    YiFei Dong
    BaoQing Yang
    LiXian Zhang
    [J]. Science China Technological Sciences, 2024, 67 : 423 - 434
  • [27] Navigation for autonomous vehicles via fast-stable and smooth reinforcement learning
    Zhang, Ruixian
    Yang, Jianan
    Liang, Ye
    Lu, Shengao
    Dong, Yifei
    Yang, Baoqing
    Zhang, Lixian
    [J]. SCIENCE CHINA-TECHNOLOGICAL SCIENCES, 2024, 67 (02) : 423 - 434
  • [28] Reinforcement Learning-Based High-Speed Path Following Control for Autonomous Vehicles
    Liu, Jia
    Cui, Yunduan
    Duan, Jianghua
    Jiang, Zhengmin
    Pan, Zhongming
    Xu, Kun
    Li, Huiyun
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (06) : 7603 - 7615
  • [29] REINFORCEMENT LEARNING-BASED ADAPTIVE MOTION CONTROL FOR AUTONOMOUS VEHICLES VIA ACTOR-CRITIC STRUCTURE
    Wang, Honghai
    Wei, Liangfen
    Wang, Xianchao
    He, Shuping
    [J]. DISCRETE AND CONTINUOUS DYNAMICAL SYSTEMS-SERIES S, 2024, 17 (09): : 2894 - 2911
  • [30] Platoon control of connected autonomous vehicles: A distributed reinforcement learning method by consensus
    Liu, Bo
    Ding, Zhengtao
    Lv, Chen
    [J]. IFAC PAPERSONLINE, 2020, 53 (02): : 15241 - 15246