Design of a Path-Following Controller for Autonomous Vehicles Using an Optimized Deep Deterministic Policy Gradient Method

被引:0
|
作者
Rizehvandi, Ali [1 ]
Azadi, Shahram [1 ]
机构
[1] KN Toosi Univ Technol, Fac Mech Engn, Tehran, Iran
关键词
Autonomous vehicles; DRL method; DDPG algorithm; Path-following; TRACKING;
D O I
10.15282/ijame.21.3.2024.18.0901
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
The need for a safe and reliable transportation system has made the advancement of autonomous vehicles (Avs) increasingly significant. To achieve Level 5 autonomy, as defined by the Society of Automotive Engineers, AVs must be capable of navigating complex and unconventional traffic environments. Path-following is a crucial task in autonomous driving, requiring precise and safe navigation along a defined path. Traditional path-tracking methods often rely on parameter tuning or rule-based approaches, which may not be suitable for dynamic and complex environments. Reinforcement learning has emerged as a powerful technique for developing effective control strategies through agent-environment interactions. This study investigates the efficiency of an optimized Deep Deterministic Policy Gradient (DDPG) method for controlling acceleration and steering in the path-following of autonomous vehicles. The algorithm demonstrates rapid convergence, enabling stable and efficient path tracking. Additionally, the trained agent achieves smooth control without extreme actions. The performance of the optimized DDPG is compared with the standard DDPG algorithm, with results confirming the improved efficiency of the optimized approach. This advancement could significantly contribute to the development of autonomous driving technology.
引用
收藏
页码:11682 / 11694
页数:13
相关论文
共 50 条
  • [31] Robust Learning-Based Gain-Scheduled Path Following Controller Design for Autonomous Ground Vehicles
    Shi, Qian
    Zhang, Hui
    Pedrycz, Witold
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (02): : 1427 - 1436
  • [32] Design of a Path-Tracking Steering Controller for Autonomous Vehicles
    Sun, Chuanyang
    Zhang, Xin
    Xi, Lihe
    Tian, Ying
    ENERGIES, 2018, 11 (06):
  • [33] Fuzzy Controller Design for Autonomous Underwater Vehicles Path Tracking
    Duy Anh Nguyen
    Do Duy Thanh
    Nguyen Tran Tien
    Pham Viet Anh
    PROCEEDINGS OF 2019 INTERNATIONAL CONFERENCE ON SYSTEM SCIENCE AND ENGINEERING (ICSSE), 2019, : 592 - 598
  • [34] Robust Path-Following Control of Underactuated Marine Vehicles Using Gradient-Descent Fuzzy Estimation
    Nazmara, Gholamreza
    Aguiar, A. Pedro
    CONTROLO 2022, 2022, 930 : 37 - 47
  • [35] Robust path-following control design of heavy vehicles based on multiobjective evolutionary optimization
    de Morais, Gustavo A. Prudencio
    Marcos, Lucas Barbosa
    Barbosa, Filipe Marques
    Barbosa, Bruno H. G.
    Terra, Marco Henrique
    Grassi, Valdir, Jr.
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 192
  • [36] Path-Following Control of Autonomous Vehicles Considering Coupling Effects and Multi-source System Uncertainties
    Liang, Yixiao
    Li, Yinong
    Yu, Yinghong
    Zhang, Zhida
    Zheng, Ling
    Ren, Yue
    AUTOMOTIVE INNOVATION, 2021, 4 (03) : 284 - 300
  • [37] Robust guaranteed-cost path-following control for autonomous vehicles on unstructured roads
    Guo, Jinghua
    Wang, Jin
    Hu, Ping
    Li, Linhui
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2018, 232 (07) : 896 - 908
  • [38] Trajectory-tracking and path-following of underactuated autonomous vehicles with parametric modeling uncertainty
    Aguiar, A. Pedro
    Hespanha, Joao P.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2007, 52 (08) : 1362 - 1379
  • [39] Path-following control of autonomous ground vehicles based on input convex neural networks
    Jiang, Kai
    Hu, Chuan
    Yan, Fengjun
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2022, 236 (13) : 2806 - 2816
  • [40] Road-Curvature-Range-Dependent Path Following Controller Design for Autonomous Ground Vehicles Subject to Stochastic Delays
    Shi, Qian
    Zhang, Hui
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) : 17440 - 17450