Achieving accurate trajectory predicting and tracking for autonomous vehicles via reinforcement learning-assisted control approaches

被引:5
作者
Tan, Guangwen [1 ]
Li, Mengshan [1 ]
Hou, Biyu [1 ]
Zhu, Jihong [1 ]
Guan, Lixin [1 ]
机构
[1] Gannan Normal Univ, Coll Phys & Elect Informat, Ganzhou 341000, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Autonomous driving; Reinforcement learning; Vehicle lane-change; Tracking control;
D O I
10.1016/j.engappai.2024.108773
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In complex urban traffic scenarios, autonomous vehicles face significant challenges in adapting to diverse and dynamic traffic conditions. Reward-based reinforcement learning has emerged as an effective approach to tackle these challenges. This paper presents a novel method that combines deep reinforcement learning with automotive dynamics systems. Building upon the Double Deep Q-learning algorithm, our approach integrates a Recurrent Neural Network with Gated Recurrent Units to enhance the environmental exploration capabilities of autonomous vehicles. To obtain more precise reward values, we introduce a trajectory tracking algorithm based on a combination of proportional-integral-derivative control and feedforward control within the automotive dynamics system. The proportional-integral-derivative controller is utilized for longitudinal control, while the Error-Optimized feedforward controller enhances lateral control, thereby improving trajectory tracking accuracy. Finally, extensive simulation experiments are conducted to evaluate the proposed method, comparing it against other baseline methods in terms of vehicle following and lane-changing scenarios. The results demonstrate that our approach significantly improves both the reward values and control performance of the algorithm.
引用
收藏
页数:17
相关论文
共 50 条
[41]   Reinforcement Learning-Based Formation Control of Autonomous Underwater Vehicles with Model Interferences [J].
Cao, Wenqiang ;
Yan, Jing ;
Yang, Xian ;
Luo, Xiaoyuan .
2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, :4020-4025
[42]   A Deep Reinforcement Learning Approach for Navigation and Control of Autonomous Underwater Vehicles in Complex Environments [J].
Stefanidou, Artemis ;
Politi, Elena ;
Chronis, Christos ;
Dimitrakopoulos, George ;
Varlamis, Iraklis .
2024 18TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION, ICARCV, 2024, :750-755
[43]   Reinforcement Learning-based Car-Following Control for Autonomous Vehicles with OTFS [J].
Liu, Yulin ;
Shi, Yuye ;
Zhang, Xiaoqi ;
Wu, Jun ;
Yang, Songyuan .
2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
[44]   Distributional Reinforcement Learning Based Integrated Decision Making and Control for Autonomous Surface Vehicles [J].
Lin, Xi ;
Szenher, Paul ;
Huang, Yewei ;
Englot, Brendan .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (02) :1194-1201
[45]   Reinforcement Learning-Based 3D Trajectory Tracking Control of Hypersonic Gliding Vehicles With Time-Varying Uncertainties [J].
Luo, Biao ;
Sun, Jingyi ;
Tang, Rui ;
Xu, Xiaodong .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 :8187-8199
[46]   Interval trajectory tracking of automatic guided vehicles via model predictive control method [J].
Xu H. ;
Zhang Y.-L. ;
Zhu J. ;
Fan Q.-Q. .
Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2020, 37 (01) :23-30
[47]   Autonomous Reconnaissance Trajectory Guidance at Small Near-Earth Asteroids via Reinforcement Learning [J].
Takahashi, Shota ;
Scheeres, Daniel J. J. .
JOURNAL OF GUIDANCE CONTROL AND DYNAMICS, 2023, 46 (07) :1280-1297
[48]   Adaptive Bitrate Algorithms via Deep Reinforcement Learning With Digital Twins Assisted Trajectory [J].
Ye, Jin ;
Qin, Shaowen ;
Xiao, Qingyu ;
Jiang, Wenchao ;
Tang, Xin ;
Li, Xiaohuan .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (04) :3522-3535
[49]   Reinforcement learning-driven autonomous navigation strategy for rotor-assisted vehicles via integral event-triggered mechanism [J].
Zhang, Guoqing ;
Li, Zhihao ;
Li, Jiqiang ;
Shu, Yaqing ;
Zhang, Xianku .
Transportation Research Part D: Transport and Environment, 2025, 146
[50]   Distributed cooperative H∞ optimal control of underactuated autonomous underwater vehicles based on reinforcement learning and prescribed performance [J].
Zhuo, Jiaoyang ;
Tian, Xuehong ;
Liu, Haitao .
OCEAN ENGINEERING, 2024, 312