Twin delayed deep deterministic reinforcement learning application in vehicle electrical suspension control

被引:5
|
作者
Shen, Daoyu [1 ]
Zhou, Shilei [1 ]
Zhang, Nong [2 ]
机构
[1] Univ Technol Sydney, Fac Engn & IT, Sch Mech & Mechatron Engn, 15 Broadway, Ultimo, NSW 2007, Australia
[2] Hefei Univ Technol, Automot Res Inst, 193 Tunxi Rd, Hefei, Peoples R China
关键词
vehicle vertical vibration; suspension system control; artificial intelligence; reinforcement learning; twin delayed deep deterministic policy (TD3); neural network design; NEURAL-NETWORK; OPTIMIZATION; SIMULATION; SYSTEM;
D O I
10.1504/IJVP.2023.133852
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Coming with the rising focus of the driving comfort request, more efforts are being delivered into the study of suspension system. Comparing with other traditional control methods, the machine learning control strategy has demonstrated its optimality in dealing with different class of roads. The work presented in this paper is to apply twin delayed deep deterministic policy gradients (TD3) in suspension control which enables suspension controller to go beyond searching for an optimal set of system parameters from traditional control method in dealing with different class of pavements. To achieve this, a suspension model has been established together with a reinforcement learning algorithm and an input signal of pavement. The performance of the twin delayed reinforcement agent is compared against deep deterministic policy gradients (DDPG) and deep Q-learning (DQN) algorithms under different types of pavement. The simulation result shows its superiority, robustness and learning efficiency over other reinforcement learning algorithms.
引用
收藏
页码:429 / 446
页数:19
相关论文
共 50 条
  • [1] A guided twin delayed deep deterministic reinforcement learning for vaccine allocation inhuman contact networks
    Ardjmand, Ehsan
    Fallahtafti, Alireza
    Yazdani, Ehsan
    Mahmoodi, Anwar
    Young II, William A.
    APPLIED SOFT COMPUTING, 2024, 167
  • [2] Deep reinforcement learning for PMSG wind turbine control via twin delayed deep deterministic policy gradient (TD3)
    Zholtayev, Darkhan
    Rubagotti, Matteo
    Do, Ton Duc
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2024, 45 (04): : 1889 - 1906
  • [3] A deep reinforcement learning-based active suspension control algorithm considering deterministic experience tracing for autonomous vehicle
    Wang, Cheng
    Cui, Xiaoxian
    Zhao, Shijie
    Zhou, Xinran
    Song, Yaqi
    Wang, Yang
    Guo, Konghui
    APPLIED SOFT COMPUTING, 2024, 153
  • [4] REINFORCEMENT LEARNING-BASED PERFORMANCE AND CONTROL ENHANCEMENT OF PMSM THROUGH POLICY GRADIENT AGENT OF TWIN DELAYED DEEP DETERMINISTIC
    Shana, Lakshmi Prasad
    Gudipalli, Abhishek
    JOURNAL OF ENGINEERING SCIENCE AND TECHNOLOGY, 2023, 18 : 58 - 71
  • [5] Twin delayed deep deterministic policy gradient-based deep reinforcement learning for energy management of fuel cell vehicle integrating durability information of powertrain
    Zhang, Yuanzhi
    Zhang, Caizhi
    Fan, Ruijia
    Huang, Shulong
    Yang, Yun
    Xu, Qianwen
    ENERGY CONVERSION AND MANAGEMENT, 2022, 274
  • [6] Optimizing Control of Wastewater Treatment Plant With Reinforcement Learning: Technical Evaluation of Twin-Delayed Deep Deterministic Policy Gradient Agent
    Klawikowska, Zuzanna
    Grochowski, Michal
    IEEE ACCESS, 2024, 12 : 130318 - 130333
  • [7] Real-Time Visual Object Tracking Based on Reinforcement Learning with Twin Delayed Deep Deterministic Algorithm
    Zheng, Shengjie
    Wang, Huan
    INTELLIGENCE SCIENCE AND BIG DATA ENGINEERING: VISUAL DATA ENGINEERING, PT I, 2019, 11935 : 165 - 177
  • [8] Adaptive control and reinforcement learning for vehicle suspension control: A review
    Kimball, Jeremy B.
    DeBoer, Benjamin
    Bubbar, Kush
    ANNUAL REVIEWS IN CONTROL, 2024, 58
  • [9] Twin actor twin delayed deep deterministic policy gradient (TATD3) learning for batch process control
    Joshi, Tanuja
    Makker, Shikhar
    Kodamana, Hariprasad
    Kandath, Harikumar
    COMPUTERS & CHEMICAL ENGINEERING, 2021, 155
  • [10] Continuous action reinforcement learning applied to vehicle suspension control
    Howell, MN
    Frost, GP
    Gordon, TJ
    Wu, QH
    MECHATRONICS, 1997, 7 (03) : 263 - 276