Achieving accurate trajectory predicting and tracking for autonomous vehicles via reinforcement learning-assisted control approaches

被引:5
作者
Tan, Guangwen [1 ]
Li, Mengshan [1 ]
Hou, Biyu [1 ]
Zhu, Jihong [1 ]
Guan, Lixin [1 ]
机构
[1] Gannan Normal Univ, Coll Phys & Elect Informat, Ganzhou 341000, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Autonomous driving; Reinforcement learning; Vehicle lane-change; Tracking control;
D O I
10.1016/j.engappai.2024.108773
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In complex urban traffic scenarios, autonomous vehicles face significant challenges in adapting to diverse and dynamic traffic conditions. Reward-based reinforcement learning has emerged as an effective approach to tackle these challenges. This paper presents a novel method that combines deep reinforcement learning with automotive dynamics systems. Building upon the Double Deep Q-learning algorithm, our approach integrates a Recurrent Neural Network with Gated Recurrent Units to enhance the environmental exploration capabilities of autonomous vehicles. To obtain more precise reward values, we introduce a trajectory tracking algorithm based on a combination of proportional-integral-derivative control and feedforward control within the automotive dynamics system. The proportional-integral-derivative controller is utilized for longitudinal control, while the Error-Optimized feedforward controller enhances lateral control, thereby improving trajectory tracking accuracy. Finally, extensive simulation experiments are conducted to evaluate the proposed method, comparing it against other baseline methods in terms of vehicle following and lane-changing scenarios. The results demonstrate that our approach significantly improves both the reward values and control performance of the algorithm.
引用
收藏
页数:17
相关论文
共 50 条
[21]   Parameterized Batch Reinforcement Learning for Longitudinal Control of Autonomous Land Vehicles [J].
Huang, Zhenhua ;
Xu, Xin ;
He, Haibo ;
Tan, Jun ;
Sun, Zhenping .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2019, 49 (04) :730-741
[22]   Hierarchical Motion Planning and Tracking for Autonomous Vehicles Using Global Heuristic Based Potential Field and Reinforcement Learning Based Predictive Control [J].
Du, Guodong ;
Zou, Yuan ;
Zhang, Xudong ;
Li, Zirui ;
Liu, Qi .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (08) :8304-8323
[23]   Tracking control of autonomous vehicles via backstepping method with dynamic surface control [J].
Yokoyama, Makoto ;
Nishikawa, Koji .
MECHANICAL ENGINEERING JOURNAL, 2025, 12 (03)
[24]   Trajectory Tracking Control for Mobile Robots Using Reinforcement Learning and PID [J].
Wang, Shuti ;
Yin, Xunhe ;
Li, Peng ;
Zhang, Mingzhi ;
Wang, Xin .
IRANIAN JOURNAL OF SCIENCE AND TECHNOLOGY-TRANSACTIONS OF ELECTRICAL ENGINEERING, 2020, 44 (03) :1059-1068
[25]   Trajectory Tracking Control for Mobile Robots Using Reinforcement Learning and PID [J].
Shuti Wang ;
Xunhe Yin ;
Peng Li ;
Mingzhi Zhang ;
Xin Wang .
Iranian Journal of Science and Technology, Transactions of Electrical Engineering, 2020, 44 :1059-1068
[26]   Reinforcement Learning Formation Tracking of Networked Autonomous Surface Vehicles With Bounded Inputs via Cloud-Supported Communication [J].
Ding, Teng-Fei ;
Ge, Ming-Feng ;
Liu, Zhi-Wei ;
Wang, Leimin ;
Liu, Jie .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (01) :469-480
[27]   Trajectory Planning and Tracking Control of Autonomous Vehicles Based on Improved Artificial Potential Field [J].
Gao, Yan ;
Li, Dazhi ;
Sui, Zhen ;
Tian, Yantao .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (09) :12468-12483
[28]   Trajectory tracking control of autonomous vehicles based on Lagrangian neural network dynamics model [J].
Yang, Wei ;
Cai, Yingfeng ;
Sun, Xiaoqiang ;
He, Youguo ;
Yuan, Chaochun ;
Wang, Hai ;
Chen, Long .
PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2024, 238 (12) :3483-3498
[29]   Navigation for autonomous vehicles via fast-stable and smooth reinforcement learning [J].
RuiXian Zhang ;
JiaNan Yang ;
Ye Liang ;
ShengAo Lu ;
YiFei Dong ;
BaoQing Yang ;
LiXian Zhang .
Science China Technological Sciences, 2024, 67 :423-434
[30]   Navigation for autonomous vehicles via fast-stable and smooth reinforcement learning [J].
Zhang, Ruixian ;
Yang, Jianan ;
Liang, Ye ;
Lu, Shengao ;
Dong, Yifei ;
Yang, Baoqing ;
Zhang, Lixian .
SCIENCE CHINA-TECHNOLOGICAL SCIENCES, 2024, 67 (02) :423-434