Design of a Path-Following Controller for Autonomous Vehicles Using an Optimized Deep Deterministic Policy Gradient Method

被引:0
|
作者
Rizehvandi, Ali [1 ]
Azadi, Shahram [1 ]
机构
[1] KN Toosi Univ Technol, Fac Mech Engn, Tehran, Iran
关键词
Autonomous vehicles; DRL method; DDPG algorithm; Path-following; TRACKING;
D O I
10.15282/ijame.21.3.2024.18.0901
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
The need for a safe and reliable transportation system has made the advancement of autonomous vehicles (Avs) increasingly significant. To achieve Level 5 autonomy, as defined by the Society of Automotive Engineers, AVs must be capable of navigating complex and unconventional traffic environments. Path-following is a crucial task in autonomous driving, requiring precise and safe navigation along a defined path. Traditional path-tracking methods often rely on parameter tuning or rule-based approaches, which may not be suitable for dynamic and complex environments. Reinforcement learning has emerged as a powerful technique for developing effective control strategies through agent-environment interactions. This study investigates the efficiency of an optimized Deep Deterministic Policy Gradient (DDPG) method for controlling acceleration and steering in the path-following of autonomous vehicles. The algorithm demonstrates rapid convergence, enabling stable and efficient path tracking. Additionally, the trained agent achieves smooth control without extreme actions. The performance of the optimized DDPG is compared with the standard DDPG algorithm, with results confirming the improved efficiency of the optimized approach. This advancement could significantly contribute to the development of autonomous driving technology.
引用
收藏
页码:11682 / 11694
页数:13
相关论文
共 50 条
  • [21] Design of Observer-Based Path Following Controllers for Autonomous Vehicles
    Wang, Heng
    Zhang, Tengfei
    Li, Qing
    Cui, Jiarui
    Zhang, Zhaolong
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 2670 - 2675
  • [22] Simultaneous Path Following and Obstacle Avoidance of Field Tracked Vehicles via Model Predictive Control with Deep Deterministic Policy Gradient
    Sung, Yu-Cheng
    Sung, Chun-Ting
    Tseng, Wen-Chuan
    Chen, Shean-Jen
    OPTICS AND PHOTONICS FOR ADVANCED DIMENSIONAL METROLOGY II, 2022, 12137
  • [23] Attack parameter dependent resilient H. path-following control design for autonomous vehicles under cyber attacks
    Hu, Songlin
    Yu, Wenxi
    Yang, Jinghui
    Chen, Xiaoli
    Xie, Xiangpeng
    Ma, Yong
    CONTROL ENGINEERING PRACTICE, 2023, 135
  • [24] Planar path following nonlinear controller design for an autonomous airship
    Zhou, Wei-xiang
    Zhou, Ping-fang
    Wang, Yue-ying
    Duan, Deng-ping
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART G-JOURNAL OF AEROSPACE ENGINEERING, 2019, 233 (05) : 1879 - 1899
  • [25] Real-time Parameter Updating and Path-following Control for Autonomous Vehicles on Slope Roads
    Liang, Zhongchao
    Chen, Yidi
    Zhao, Jing
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2022, 20 (07) : 2178 - 2190
  • [26] Three-dimensional path-following control of nonlinear autonomous underwater vehicles with actuator saturation
    Kim, Moon Hwan
    Lee, Donghwan
    Kim, Do Wan
    OCEAN ENGINEERING, 2025, 317
  • [27] Coordinated path-following control of distributed autonomous vehicles with obstacles and collision avoidance
    Ghasemi, Iman
    Tahmasbi, Mohammad
    Ahmadian, Saeid
    Sayyaadi, Hassan
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART C-JOURNAL OF MECHANICAL ENGINEERING SCIENCE, 2024, 238 (12) : 5865 - 5879
  • [28] Nonlinear path-following method for fixed-wing unmanned aerial vehicles
    Zhang, Jia-ming
    Li, Qing
    Cheng, Nong
    Liang, Bin
    JOURNAL OF ZHEJIANG UNIVERSITY-SCIENCE C-COMPUTERS & ELECTRONICS, 2013, 14 (02): : 125 - 132
  • [29] Internal Model-Based Robust Path-Following Control for Autonomous Vehicles
    Adorján Kovács
    István Vajk
    International Journal of Automotive Technology, 2024, 25 : 249 - 260
  • [30] A Novel Approach to Light Detection and Ranging Sensor Placement for Autonomous Driving Vehicles Using Deep Deterministic Policy Gradient Algorithm
    Berens, Felix
    Ambs, Jordan
    Elser, Stefan
    Reischl, Markus
    SAE INTERNATIONAL JOURNAL OF CONNECTED AND AUTOMATED VEHICLES, 2024, 7 (03): : 303 - 308