Reinforcement Learning-Based Tracking Control for Two Time-Scale Looper Hydraulic Servo Systems

被引：0
|
作者：
Mi, Xuanrui [1 ]
Wang, Yudong [1 ]
Wu, Jiacheng [1 ]
Shen, Hao [1 ]
机构：
[1] Anhui Univ Technol, Sch Elect & Informat Engn, Maanshan 243032, Peoples R China
来源：
JOURNAL OF DYNAMIC SYSTEMS MEASUREMENT AND CONTROL-TRANSACTIONS OF THE ASME | 2023年 / 145卷 / 11期
基金：
中国国家自然科学基金;
关键词：
HOT; MODEL; STRATEGY;
D O I：
10.1115/1.4063251
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Looper hydraulic servosystems (HSSs) are used in a variety of complex industrial environments. It is worth noting that there exists two-time-scale phenomenon in looper hydraulic servosystems. In this technical brief, the model of the looper hydraulic servosystems with two-time-scale phenomenon is established. In the framework of reinforcement learning, an optimal tracking control policy for looper hydraulic servosystems is proposed, which considers the effects of two-time-scale phenomena on the system. Then, by analyzing the change of looper angle in the actual industrial production process, the designed controller has a faster transition time compared to the proportional integral differential controller. In addition, the convergence of the optimal control solution obtained by using the proposed algorithm is proved. Finally, the effectiveness of the proposed method is verified by the simulation.
引用
收藏
页数：7
相关论文
共 50 条
  • [21] Finite-Time Performance Bounds and Adaptive Learning Rate Selection for Two Time-Scale Reinforcement Learning
    Gupta, Harsh
    Srikant, R.
    Ying, Lei
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [22] Reinforcement Learning for Input Constrained Sub-optimal Tracking Control in Discrete-time Two-time-scale Systems
    Que, Xuejie
    Wang, Zhenlei
    Wang, Xin
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2023, 21 (09) : 3068 - 3079
  • [23] Reinforcement Learning for Input Constrained Sub-optimal Tracking Control in Discrete-time Two-time-scale Systems
    Xuejie Que
    Zhenlei Wang
    Xin Wang
    International Journal of Control, Automation and Systems, 2023, 21 (9) : 3068 - 3079
  • [24] H∞ optimal output tracking control for Markov jump systems: A reinforcement learning-based approach
    Shen, Ying
    Yao, Cai-Kang
    Chen, Bo
    Che, Wei-Wei
    Wu, Zheng-Guang
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2024, 34 (08) : 5149 - 5167
  • [25] Reinforcement Learning-Based Robust Tracking Control for Unknown Markov Jump Systems and its Application
    Shen, Hao
    Wu, Jiacheng
    Wang, Yun
    Wang, Jing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2024, 71 (03) : 1211 - 1215
  • [26] Reinforcement Learning-Based Adaptive Optimal Exponential Tracking Control of Linear Systems With Unknown Dynamics
    Chen, Ci
    Modares, Hamidreza
    Xie, Kan
    Lewis, Frank L.
    Wan, Yan
    Xie, Shengli
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2019, 64 (11) : 4423 - 4438
  • [27] Reinforcement Learning Control of Hydraulic Servo System Based on TD3 Algorithm
    Yuan, Xiaoming
    Wang, Yu
    Zhang, Ruicong
    Gao, Qiang
    Zhou, Zhuangding
    Zhou, Rulin
    Yin, Fengyuan
    MACHINES, 2022, 10 (12)
  • [28] Control Strategy of Speed Servo Systems Based on Deep Reinforcement Learning
    Chen, Pengzhan
    He, Zhiqiang
    Chen, Chuanxi
    Xu, Jiahong
    ALGORITHMS, 2018, 11 (05):
  • [29] Reinforcement Learning-Based Robust Tracking Control Application to Morphing Aircraft
    Yang, Zhicheng
    Tan, Junbo
    Wang, Xueqian
    Yao, Zongxin
    Liang, Bin
    2023 AMERICAN CONTROL CONFERENCE, ACC, 2023, : 2757 - 2762
  • [30] Robust Reinforcement Learning-Based Tracking Control for Wheeled Mobile Robot
    Nguyen Tan Luy
    Nguyen Duc Thanh
    Nguyen Thien Thanh
    Nguyen Thi Phuong Ha
    2010 2ND INTERNATIONAL CONFERENCE ON COMPUTER AND AUTOMATION ENGINEERING (ICCAE 2010), VOL 1, 2010, : 171 - 176
12345