MPC-TD3 Trajectory Tracking Control for Electrically Driven Unmanned Tracked Vehicles

被引:1
作者
Chen, Yuxuan [1 ]
Gai, Jiangtao [1 ]
He, Shuai [1 ]
Li, Huanhuan [1 ]
Cheng, Cheng [1 ]
Zou, Wujun [1 ]
机构
[1] China North Vehicle Res Inst, Beijing 100072, Peoples R China
关键词
unmanned tracked vehicles; model predictive control; reinforcement learning; TD3; trajectory tracking control;
D O I
10.3390/electronics13183747
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To address the trajectory tracking issue of unmanned tracked vehicles, the majority of studies employ the Model Predictive Control (MPC). The MPC imposes high demands on model accuracy. Due to factors such as environmental interference, actuator constraints, and the nonlinearity of vehicles under high-speed conditions, dynamic and kinematic models fail to accurately delineate the motion process of tracked vehicles. Aiming at the problem of insufficient trajectory tracking precision of unmanned tracked vehicles, a trajectory tracking controller jointly controlled by the Twin Delayed Deep Deterministic policy gradient (TD3) algorithm and the MPC algorithm is developed. During offline training, the agent acquires the discrepancies between the model and the environment under various working conditions and optimizes its own network; during online reasoning, the agent adaptively compensates the output of the MPC based on the vehicle state. The experimental results indicate that, compared with the pure MPC algorithm, the MPC algorithm compensated based on the TD3 algorithm reduces the lateral errors by 41.67% and 22.55%, respectively, in circular and double-lane-change trajectory conditions.
引用
收藏
页数:16
相关论文
共 20 条
[1]   A path-tracking algorithm using predictive Stanley lateral controller [J].
AbdElmoniem, Ahmed ;
Osama, Ahmed ;
Abdelaziz, Mohamed ;
Maged, Shady A. .
INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2020, 17 (06)
[2]   Accurate Path Tracking by Adjusting Look-Ahead Point in Pure Pursuit Method [J].
Ahn, Joonwoo ;
Shin, Seho ;
Kim, Minsung ;
Park, Jaeheung .
INTERNATIONAL JOURNAL OF AUTOMOTIVE TECHNOLOGY, 2021, 22 (01) :119-129
[3]   Trajectory tracking control of tracked vehicles considering nonlinearities due to slipping while skid-steering [J].
Al-Jarrah, Ahmad ;
Salah, Mohammad .
SYSTEMS SCIENCE & CONTROL ENGINEERING, 2022, 10 (01) :887-898
[4]   Deep reinforcement learning based path tracking controller for autonomous vehicle [J].
Chen, I-Ming ;
Chan, Ching-Yao .
PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2021, 235 (2-3) :541-551
[5]   Complex Trajectory Tracking Using PID Control for Autonomous Driving [J].
Farag, Wael .
INTERNATIONAL JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS RESEARCH, 2020, 18 (02) :356-366
[6]   Research on Steering Stability Control of Electric Drive Tracked Vehicle [J].
Hou X. ;
Ma Y. ;
Xiang C. .
Jixie Gongcheng Xuebao/Journal of Mechanical Engineering, 2024, 60 (08) :233-244
[7]   Electric Drive Technology Trends, Challenges, and Opportunities for Future Electric Vehicles [J].
Husain, Iqbal ;
Ozpineci, Burak ;
Islam, Md Sariful ;
Gurpinar, Emre ;
Su, Gui-Jia ;
Yu, Wensong ;
Chowdhury, Shajjad ;
Xue, Lincoln ;
Rahman, Dhrubo ;
Sahu, Raj .
PROCEEDINGS OF THE IEEE, 2021, 109 (06) :1039-1059
[8]   Reinforcement-Tracking: An Effective Trajectory Tracking and Navigation Method for Autonomous Urban Driving [J].
Liu, Meng ;
Zhao, Fei ;
Yin, Jialun ;
Niu, Jianwei ;
Liu, Yu .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) :6991-7007
[9]   Modelling and control strategies in path tracking control for autonomous tracked vehicles: A review of state of the art and challenges [J].
Ruslan, Noor Amira Ilyanie ;
Amer, Noor Hafizah ;
Hudha, Khisbullah ;
Kadir, Zulkiffli Abdul ;
Ishak, Saiddi Ali Firdaus Mohamed ;
Dardin, Syed Mohd Fairuz Syed .
JOURNAL OF TERRAMECHANICS, 2023, 105 :67-79
[10]   ROS-based trajectory tracking control for autonomous tracked vehicle using optimized backstepping and sliding mode control [J].
Sabiha, Ahmed D. ;
Kamel, Mohamed A. ;
Said, Ehab ;
Hussein, Wessam M. .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2022, 152