Twin delayed deep deterministic reinforcement learning application in vehicle electrical suspension control

被引:5
|
作者
Shen, Daoyu [1 ]
Zhou, Shilei [1 ]
Zhang, Nong [2 ]
机构
[1] Univ Technol Sydney, Fac Engn & IT, Sch Mech & Mechatron Engn, 15 Broadway, Ultimo, NSW 2007, Australia
[2] Hefei Univ Technol, Automot Res Inst, 193 Tunxi Rd, Hefei, Peoples R China
关键词
vehicle vertical vibration; suspension system control; artificial intelligence; reinforcement learning; twin delayed deep deterministic policy (TD3); neural network design; NEURAL-NETWORK; OPTIMIZATION; SIMULATION; SYSTEM;
D O I
10.1504/IJVP.2023.133852
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Coming with the rising focus of the driving comfort request, more efforts are being delivered into the study of suspension system. Comparing with other traditional control methods, the machine learning control strategy has demonstrated its optimality in dealing with different class of roads. The work presented in this paper is to apply twin delayed deep deterministic policy gradients (TD3) in suspension control which enables suspension controller to go beyond searching for an optimal set of system parameters from traditional control method in dealing with different class of pavements. To achieve this, a suspension model has been established together with a reinforcement learning algorithm and an input signal of pavement. The performance of the twin delayed reinforcement agent is compared against deep deterministic policy gradients (DDPG) and deep Q-learning (DQN) algorithms under different types of pavement. The simulation result shows its superiority, robustness and learning efficiency over other reinforcement learning algorithms.
引用
收藏
页码:429 / 446
页数:19
相关论文
共 50 条
  • [31] Reinforcement Learning for Non-Deterministic Transition Systems With an Application to Symbolic Control
    Borri, Alessandro
    Possieri, Corrado
    IEEE CONTROL SYSTEMS LETTERS, 2023, 7 : 1610 - 1615
  • [32] Twin Delayed Multi-Agent Deep Deterministic Policy Gradient
    Zhan, Mengying
    Chen, Jinchao
    Du, Chenglie
    Duan, Yuxin
    PROCEEDINGS OF THE 2021 IEEE INTERNATIONAL CONFERENCE ON PROGRESS IN INFORMATICS AND COMPUTING (PIC), 2021, : 48 - 52
  • [33] Twin-Delayed Deep Deterministic Policy Gradient Algorithm to Control a Boost Converter in a DC Microgrid
    Muktiadji, Rifqi Firmansyah
    Ramli, Makbul A. M.
    Milyani, Ahmad H.
    ELECTRONICS, 2024, 13 (02)
  • [34] Moderated reinforcement learning of active and semi-active vehicle suspension control laws
    Frost, GP
    Gordon, TJ
    Howell, MN
    Wu, QH
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART I-JOURNAL OF SYSTEMS AND CONTROL ENGINEERING, 1996, 210 (04) : 249 - 257
  • [35] Automated guided vehicle dispatching and routing integration via digital twin with deep reinforcement learning
    Zhang, Lixiang
    Yang, Chen
    Yan, Yan
    Cai, Ze
    Hu, Yaoguang
    JOURNAL OF MANUFACTURING SYSTEMS, 2024, 72 : 492 - 503
  • [36] Robust Traffic Signal Timing Control using Multiagent Twin Delayed Deep Deterministic Policy Gradients
    Shanmugasundaram, Priya
    Bhatnagar, Shalabh
    ICAART: PROCEEDINGS OF THE 14TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE - VOL 2, 2022, : 477 - 485
  • [37] Active Disturbance Rejection Control Based on Twin-Delayed Deep Deterministic Policy Gradient for an Exoskeleton
    Li, Zhong
    Guan, Xiaorong
    Liu, Chunyang
    Li, Dingzhe
    He, Long
    Cao, Yanfeng
    Long, Yi
    JOURNAL OF BIONIC ENGINEERING, 2025,
  • [38] Twin-Delayed Deep Deterministic Policy Gradient for Low-Frequency Oscillation Damping Control
    Cui, Qiushi
    Kim, Gyoungjae
    Weng, Yang
    ENERGIES, 2021, 14 (20)
  • [39] An Intelligent Energy Management Strategy for Hybrid Vehicle with irrational actions using Twin Delayed Deep Deterministic Policy Gradient
    Liu, Zemin Eitan
    Zhou, Quan
    Li, Yanfei
    Shuai, Shijin
    IFAC PAPERSONLINE, 2021, 54 (10): : 546 - 551
  • [40] Reinforcement Learning Control with Deep Deterministic Policy Gradient Algorithm for Multivariable pH Process
    Panjapornpon, Chanin
    Chinchalongporn, Patcharapol
    Bardeeniz, Santi
    Makkayatorn, Ratthanita
    Wongpunnawat, Witchaya
    PROCESSES, 2022, 10 (12)