Adaptive Prescribed-Time Optimal Control for Flexible-Joint Robots via Reinforcement Learning

被引:0
|
作者
Xie, Shiyu [1 ]
Sun, Wei [1 ]
Sun, Yougang [2 ]
Su, Shun-Feng [3 ]
机构
[1] Liaocheng Univ, Sch Math Sci, Liaocheng 252000, Peoples R China
[2] Tongji Univ, Inst Rail Transit, Shanghai 201804, Peoples R China
[3] Natl Taiwan Univ Sci & Technol, Dept Elect Engn, Taipei 106, Taiwan
来源
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS | 2025年
基金
中国国家自然科学基金;
关键词
Robots; Optimal control; Sun; MIMO; Backstepping; Vectors; Program processors; Process control; Performance analysis; Actor-critic structure; flexible-joint (FJ) robots; fuzzy logic systems (FLSs); prescribed-time optimal control; reinforcement learning (RL); TRACKING CONTROL;
D O I
10.1109/TSMC.2024.3524448
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article proposes a prescribed-time fuzzy optimal control approach for flexible-joint (FJ) robot systems utilizing the reinforcement learning (RL) strategy. The uniqueness of this method lies in its ability to ensure optimal tracking performance for n-link flexible joint robots within the prescribed-time frame, while the actor and critic fuzzy logic system effectively approximate the optimal cost and evaluates system performance. First, the optimal controllers with the auxiliary compensation term are constructed by utilizing the online approximation of the modified performance index function and RL actor-critic structure. The designed controller can deal with unknown structure impacts and avoid model identification. Besides, in designing the prescribed-time scale function, the introduced constant term not only prevents singularity but also allows flexible setting of constraint regions. The proposed scheme is theoretically verified to satisfy the Bellman optimality principle and ensure the tracking error converges to the desired zone within the prescribed time. Finally, the practicability of the designed control scheme is further demonstrated by the 2-link FJ robot simulation example.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Geometric prescribed-time control of quadrotors with adaptive extended state observers
    Wang, Liping
    Pei, Hailong
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2024, 34 (11) : 7460 - 7479
  • [32] Predefined-time impedance control of free-flying flexible-joint space robots for force sensor-less target capturing with prescribed performance
    Gu, Xiutao
    Liu, Liaoxue
    Wang, Lu
    Mao, Jianheng
    Guo, Yu
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2025, 35 (02) : 452 - 478
  • [33] Prescribed Performance Control for Uncertain Flexible-joint Robotic Manipulators Driven by DC Motors
    Jian Li
    Kaifa Ma
    Zhaojing Wu
    International Journal of Control, Automation and Systems, 2021, 19 : 1640 - 1650
  • [34] Prescribed Performance Control for Uncertain Flexible-joint Robotic Manipulators Driven by DC Motors
    Li, Jian
    Ma, Kaifa
    Wu, Zhaojing
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2021, 19 (04) : 1640 - 1650
  • [35] A Simple Adaptive Control Approach For Flexible Joint Robots
    Huang Jinming
    Liu Zhenguo
    2014 33RD CHINESE CONTROL CONFERENCE (CCC), 2014, : 8741 - 8746
  • [36] COMPOSITE ADAPTIVE-CONTROL OF FLEXIBLE JOINT ROBOTS
    YUAN, J
    STEPANENKO, Y
    AUTOMATICA, 1993, 29 (03) : 609 - 619
  • [37] Reinforcement Learning for Adaptive Optimal Stationary Control of Linear Stochastic Systems
    Pang, Bo
    Jiang, Zhong-Ping
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (04) : 2383 - 2390
  • [38] Fixed-Time Neuro-Optimal Adaptive Control With Input Saturation for Uncertain Robots
    Fan, Yanli
    Yang, Chenguang
    Li, Yongming
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (17): : 28906 - 28917
  • [39] Reinforcement learning for adaptive optimal control of continuous-time linear periodic systems
    Pang, Bo
    Jiang, Zhong-Ping
    Mareels, Iven
    AUTOMATICA, 2020, 118
  • [40] Robust Output Feedback Tracking Control for Flexible-Joint Robots Based on CTSMC Technique
    Wang, Huiming
    Peng, Weiwei
    Tan, Xin
    Sun, Jiankun
    Tang, Xianlun
    Chen, I-Ming
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2021, 68 (06) : 1982 - 1986