Hybrid Path Tracking Control for Autonomous Trucks: Integrating Pure Pursuit and Deep Reinforcement Learning With Adaptive Look-Ahead Mechanism

被引:0
作者
Han, Zhixuan [1 ]
Chen, Peng [1 ]
Zhou, Bin [1 ]
Yu, Guizhen [1 ]
机构
[1] Beihang Univ, Minist Ind & Informat Technol, Sch Transportat Sci & Engn, Key Lab Autonomous Transportat Technol Special Veh, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
Vehicle dynamics; Heuristic algorithms; Adaptation models; Stability analysis; Accuracy; Optimization; Deep reinforcement learning; Autonomous vehicles; Training; Target tracking; Path tracking control; deep reinforcement learning (DRL); adaptive look-ahead mechanism; high-speed turns;
D O I
10.1109/TITS.2025.3530507
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Path tracking control is essential for ensuring the safe and efficient operation of autonomous trucks, but traditional methods often struggle with nonlinear vehicle dynamics. While deep reinforcement learning (DRL) approaches are model-free, they may lack the stability and interpretability required for reliable deployment. This study presents a hybrid control framework that combines Pure Pursuit (PP) with Proximal Policy Optimization (PPO) to enhance tracking accuracy and robustness. PP provides baseline stability and interpretability, while PPO refines control actions by optimizing policy gradients, ensuring better adaptability to nonlinear dynamics and complex driving conditions. An adaptive look-ahead mechanism, responsive to speed and curvature, dynamically adjusts preview distances using PPO-generated coefficients, facilitating early corrections during high-speed turns and enabling greater precision on sharp curves. A fusion training method, leveraging high-reward initialization and a decreasing learning rate, supports efficient exploration and stable convergence. The approach was validated in a high-fidelity simulation environment using PreScan, Simulink, and ROS, along with real-world experiments on a proportionally scaled intelligent vehicle chassis, demonstrating notable improvements in path tracking accuracy and robustness across varied path profiles.
引用
收藏
页码:7098 / 7112
页数:15
相关论文
共 37 条
[1]   Accurate Path Tracking by Adjusting Look-Ahead Point in Pure Pursuit Method [J].
Ahn, Joonwoo ;
Shin, Seho ;
Kim, Minsung ;
Park, Jaeheung .
INTERNATIONAL JOURNAL OF AUTOMOTIVE TECHNOLOGY, 2021, 22 (01) :119-129
[2]   Path Following for Autonomous Mobile Robots with Deep Reinforcement Learning [J].
Cao, Yu ;
Ni, Kan ;
Kawaguchi, Takahiro ;
Hashimoto, Seiji .
SENSORS, 2024, 24 (02)
[3]   Deep reinforcement learning based path tracking controller for autonomous vehicle [J].
Chen, I-Ming ;
Chan, Ching-Yao .
PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2021, 235 (2-3) :541-551
[4]   Milestones in Autonomous Driving and Intelligent Vehicles-Part 1: Control, Computing System Design, Communication, HD Map, Testing, and Human Behaviors [J].
Chen, Long ;
Li, Yuchen ;
Huang, Chao ;
Xing, Yang ;
Tian, Daxin ;
Li, Li ;
Hu, Zhongxu ;
Teng, Siyu ;
Lv, Chen ;
Wang, Jinjun ;
Cao, Dongpu ;
Zheng, Nanning ;
Wang, Fei-Yue .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (09) :5831-5847
[5]   Trajectory Tracking of Autonomous Vehicle Based on Model Predictive Control With PID Feedback [J].
Chu, Duanfeng ;
Li, Haoran ;
Zhao, Chenyang ;
Zhou, Tuqiang .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (02) :2239-2250
[6]   A Review of Motion Planning for Highway Autonomous Driving [J].
Claussmann, Laurene ;
Revilloud, Marc ;
Gruyer, Dominique ;
Glaser, Sebastien .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (05) :1826-1848
[7]  
Conlter R. C., 1992, CMURITR9201
[8]  
Dong J., 2020, ARXIV
[9]   Uniform Finite Time Safe Path Tracking Control for Obstacle Avoidance of Autonomous Vehicle via Barrier Function Approach [J].
Han, Jinheng ;
Zhang, Junzhi ;
He, Chengkun ;
Lv, Chen ;
Wei, Henglai ;
Zhang, Junfeng ;
Zhao, Shiyue .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (08) :9512-9523
[10]   Exploring the Role of Autonomous Trucks in Addressing Challenges within the Trucking Industry: A Comprehensive Review [J].
Hasiri, Ali ;
Kermanshah, Amirhassan .
SYSTEMS, 2024, 12 (09)