Reinforcement Learning-Based Tracking Control for Two Time-Scale Looper Hydraulic Servo Systems

被引：0
|
作者：
Mi, Xuanrui [1 ]
Wang, Yudong [1 ]
Wu, Jiacheng [1 ]
Shen, Hao [1 ]
机构：
[1] Anhui Univ Technol, Sch Elect & Informat Engn, Maanshan 243032, Peoples R China
来源：
JOURNAL OF DYNAMIC SYSTEMS MEASUREMENT AND CONTROL-TRANSACTIONS OF THE ASME | 2023年 / 145卷 / 11期
基金：
中国国家自然科学基金;
关键词：
HOT; MODEL; STRATEGY;
D O I：
10.1115/1.4063251
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Looper hydraulic servosystems (HSSs) are used in a variety of complex industrial environments. It is worth noting that there exists two-time-scale phenomenon in looper hydraulic servosystems. In this technical brief, the model of the looper hydraulic servosystems with two-time-scale phenomenon is established. In the framework of reinforcement learning, an optimal tracking control policy for looper hydraulic servosystems is proposed, which considers the effects of two-time-scale phenomena on the system. Then, by analyzing the change of looper angle in the actual industrial production process, the designed controller has a faster transition time compared to the proportional integral differential controller. In addition, the convergence of the optimal control solution obtained by using the proposed algorithm is proved. Finally, the effectiveness of the proposed method is verified by the simulation.
引用
收藏
页数：7
相关论文
共 50 条
  • [1] Reinforcement-Learning-Based Composite Optimal Control for Looper Hydraulic Servo Systems in Hot Strip Rolling
    Wang, Yudong
    Shen, Hao
    Wu, Jiacheng
    Yan, Huaicheng
    Xu, Shengyuan
    IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2023, 28 (05) : 2495 - 2504
  • [2] Reinforcement Learning-Based Sliding Mode Tracking Control for the Two-Time-Scale Systems: Dealing With Actuator Attacks
    Zhang, Ying
    Ma, Lei
    Yang, Chunyu
    Dai, Wei
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2022, 69 (09) : 3819 - 3823
  • [3] Reinforcement Learning-Based Tracking Control for Networked Control Systems With DoS Attacks
    Liu, Jinliang
    Dong, Yanhui
    Zha, Lijuan
    Xie, Xiangpeng
    Tian, Engang
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 4188 - 4197
  • [4] Reinforcement Learning-Based Tracking Control for a Class of Discrete-Time Systems With Actuator Fault
    Liu, Yingying
    Wang, Zhanshan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2022, 69 (06) : 2827 - 2831
  • [5] Reinforcement learning-based robust optimal tracking control for disturbed nonlinear systems
    Zhong-Xin Fan
    Lintao Tang
    Shihua Li
    Rongjie Liu
    Neural Computing and Applications, 2023, 35 : 23987 - 23996
  • [6] Reinforcement learning-based robust optimal tracking control for disturbed nonlinear systems
    Fan, Zhong-Xin
    Tang, Lintao
    Li, Shihua
    Liu, Rongjie
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (33): : 23987 - 23996
  • [7] Effect of Optimization Time-Scale on Learning-Based Cooperative Merging Control at a Nonsignalized Intersection
    Katagiri, Shintaro
    Miwa, Tomio
    Tashiro, Mutsumi
    Morikawa, Takayuki
    IEEE ACCESS, 2023, 11 : 32857 - 32868
  • [8] Machine Learning-Based Model Predictive Control of Two-Time-Scale Systems
    Alnajdi, Aisha
    Abdullah, Fahim
    Suryavanshi, Atharva
    Christofides, Panagiotis D.
    MATHEMATICS, 2023, 11 (18)
  • [9] REINFORCEMENT LEARNING-BASED CONTROL OF A HYDRAULIC PRESS WITH MULTIPLE ACTUATORS
    Makansi, Faried
    Huang, Jingkai
    Schmitz, Katharina
    PROCEEDINGS OF ASME/BATH 2023 SYMPOSIUM ON FLUID POWER AND MOTION CONTROL, FPMC2023, 2023,
  • [10] Reinforcement Learning Reduced H∞ Output Tracking Control of Nonlinear Two-Time-Scale Industrial Systems
    Liu, Xiaomin
    Li, Gonghe
    Zhou, Linna
    Yang, Chunyu
    Chen, Xinkai
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (02) : 2465 - 2476
12345