Reinforcement Learning-Based Tracking Control for Two Time-Scale Looper Hydraulic Servo Systems

被引：0
|
作者：
Mi, Xuanrui [1 ]
Wang, Yudong [1 ]
Wu, Jiacheng [1 ]
Shen, Hao [1 ]
机构：
[1] Anhui Univ Technol, Sch Elect & Informat Engn, Maanshan 243032, Peoples R China
来源：
JOURNAL OF DYNAMIC SYSTEMS MEASUREMENT AND CONTROL-TRANSACTIONS OF THE ASME | 2023年 / 145卷 / 11期
基金：
中国国家自然科学基金;
关键词：
HOT; MODEL; STRATEGY;
D O I：
10.1115/1.4063251
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Looper hydraulic servosystems (HSSs) are used in a variety of complex industrial environments. It is worth noting that there exists two-time-scale phenomenon in looper hydraulic servosystems. In this technical brief, the model of the looper hydraulic servosystems with two-time-scale phenomenon is established. In the framework of reinforcement learning, an optimal tracking control policy for looper hydraulic servosystems is proposed, which considers the effects of two-time-scale phenomena on the system. Then, by analyzing the change of looper angle in the actual industrial production process, the designed controller has a faster transition time compared to the proportional integral differential controller. In addition, the convergence of the optimal control solution obtained by using the proposed algorithm is proved. Finally, the effectiveness of the proposed method is verified by the simulation.
引用
收藏
页数：7
相关论文
共 50 条
  • [31] Reinforcement Learning-Based Tracking Control of USVs in Varying Operational Conditions
    Martinsen, Andreas B.
    Lekkas, Anastasios M.
    Gros, Sebastien
    Glomsrud, Jon Arne
    Pedersen, Tom Arne
    FRONTIERS IN ROBOTICS AND AI, 2020, 7
  • [32] Reinforcement learning-based intelligent tracking control for wheeled mobile robot
    Nguyen Tan Luy
    Nguyen Thien Thanh
    Hoang Minh Tri
    TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2014, 36 (07) : 868 - 877
  • [33] Reinforcement learning-based integrated active fault diagnosis and tracking control
    Yan, Zichen
    Xu, Feng
    Tan, Junbo
    Liu, Houde
    Liang, Bin
    ISA TRANSACTIONS, 2023, 132 : 364 - 376
  • [34] Reinforcement learning-based NMPC for tracking control of ASVs: Theory and experiments
    Martinsen, Andreas B.
    Lekkas, Anastasios M.
    Gros, Sebastien
    CONTROL ENGINEERING PRACTICE, 2022, 120
  • [35] Reinforcement Learning-Based Predefined-Time Tracking Control for Nonlinear Systems Under Identifier-Critic-Actor Structure
    Wang, Jing
    Zhao, Wei
    Cao, Jinde
    Park, Ju H.
    Shen, Hao
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, : 6345 - 6357
  • [36] Event-Triggered Reinforcement Learning-Based Adaptive Tracking Control for Completely Unknown Continuous-Time Nonlinear Systems
    Guo, Xinxin
    Yan, Weisheng
    Cui, Rongxin
    IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (07) : 3231 - 3242
  • [37] ε-Dependent Controllability for Two Time-Scale Systems
    胡叶楠
    孙富春
    刘华平
    吴昊
    Tsinghua Science and Technology, 2009, (02) : 271 - 280
  • [38] Online PID Tuning Strategy for Hydraulic Servo Control Systems via SAC-Based Deep Reinforcement Learning
    He, Jianhui
    Su, Shijie
    Wang, Hairong
    Chen, Fan
    Yin, BaoJi
    MACHINES, 2023, 11 (06)
  • [39] Prescribed-time formation tracking in multi-agent systems via reinforcement learning-based hybrid impulsive control with time delays
    Liang, Zhanlue
    Gu, Yanlin
    Li, Ping
    Tao, Yiwen
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 272
  • [40] Reinforcement learning-based neural control for discrete-time nonlinear systems via deterministic learning
    Zhang, Fukai
    Zhu, Zejian
    Chen, Tianrui
    Wu, Weiming
    Wang, Cong
    NONLINEAR DYNAMICS, 2024, : 9981 - 10003
12345