Design of a Path-Following Controller for Autonomous Vehicles Using an Optimized Deep Deterministic Policy Gradient Method

被引:0
|
作者
Rizehvandi, Ali [1 ]
Azadi, Shahram [1 ]
机构
[1] KN Toosi Univ Technol, Fac Mech Engn, Tehran, Iran
关键词
Autonomous vehicles; DRL method; DDPG algorithm; Path-following; TRACKING;
D O I
10.15282/ijame.21.3.2024.18.0901
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
The need for a safe and reliable transportation system has made the advancement of autonomous vehicles (Avs) increasingly significant. To achieve Level 5 autonomy, as defined by the Society of Automotive Engineers, AVs must be capable of navigating complex and unconventional traffic environments. Path-following is a crucial task in autonomous driving, requiring precise and safe navigation along a defined path. Traditional path-tracking methods often rely on parameter tuning or rule-based approaches, which may not be suitable for dynamic and complex environments. Reinforcement learning has emerged as a powerful technique for developing effective control strategies through agent-environment interactions. This study investigates the efficiency of an optimized Deep Deterministic Policy Gradient (DDPG) method for controlling acceleration and steering in the path-following of autonomous vehicles. The algorithm demonstrates rapid convergence, enabling stable and efficient path tracking. Additionally, the trained agent achieves smooth control without extreme actions. The performance of the optimized DDPG is compared with the standard DDPG algorithm, with results confirming the improved efficiency of the optimized approach. This advancement could significantly contribute to the development of autonomous driving technology.
引用
收藏
页码:11682 / 11694
页数:13
相关论文
共 50 条
  • [41] Robust Switched Velocity-Dependent Path-Following Control for Autonomous Ground Vehicles
    Li, Panshuo
    Lam, James
    Lu, Renquan
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (05) : 4815 - 4826
  • [42] A Path-Following Controller for Marine Vehicles Using a Two-Scale Inner-Outer Loop Approach
    Maurya, Pramod
    Morishita, Helio Mitio
    Pascoal, Antonio
    Aguiar, A. Pedro
    SENSORS, 2022, 22 (11)
  • [43] Real-time model predictive control of path-following for autonomous vehicles towards model mismatch and uncertainty
    Zhao, Wenqiang
    Wei, Hongqian
    Ai, Qiang
    Zheng, Nan
    Lin, Chen
    Zhang, Youtong
    CONTROL ENGINEERING PRACTICE, 2024, 153
  • [44] Observer-based prescribed performance path-following control for autonomous ground vehicles via error shifting method
    Wang, Zhongnan
    Liang, Zhongchao
    Ding, Zhengtao
    NONLINEAR DYNAMICS, 2024, 112 (12) : 10061 - 10080
  • [45] Deep Reinforcement Learning Controller for 3D Path Following and Collision Avoidance by Autonomous Underwater Vehicles
    Havenstrom, Simen Theie
    Rasheed, Adil
    San, Omer
    FRONTIERS IN ROBOTICS AND AI, 2021, 7
  • [46] Event-Based Path-Planning and Path-Following in Unknown Environments for Underactuated Autonomous Underwater Vehicles
    Ulyanov, Sergey
    Bychkov, Igor
    Maksimkin, Nikolay
    APPLIED SCIENCES-BASEL, 2020, 10 (21): : 1 - 22
  • [47] A Computationally Efficient Path-Following Control Strategy of Autonomous Electric Vehicles With Yaw Motion Stabilization
    Guo, Ningyuan
    Zhang, Xudong
    Zou, Yuan
    Lenzo, Basilio
    Zhang, Tao
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2020, 6 (02) : 728 - 739
  • [48] A Planar Path-Following Model Predictive Controller for Fixed-Wing Unmanned Aerial Vehicles
    Alessandretti, Andrea
    Pedro Aguiar, A.
    2017 11TH INTERNATIONAL WORKSHOP ON ROBOT MOTION AND CONTROL (ROMOCO), 2017, : 53 - 58
  • [49] Nonlinear path-following method for fixed-wing unmanned aerial vehicles
    Jia-ming ZHANG
    Qing LI
    Nong CHENG
    Bin LIANG
    Frontiers of Information Technology & Electronic Engineering, 2013, 14 (02) : 125 - 132
  • [50] Nonlinear path-following method for fixed-wing unmanned aerial vehicles
    Jia-ming Zhang
    Qing Li
    Nong Cheng
    Bin Liang
    Journal of Zhejiang University SCIENCE C, 2013, 14 : 125 - 132