Optimized leader-follower consensus control using combination of reinforcement learning and sliding mode mechanism for multiple robot manipulator system

被引:2
作者
Song, Yanfen [1 ]
Li, Zijun [1 ]
Li, Bin [1 ]
Wen, Guoxing [1 ,2 ,3 ]
机构
[1] Qilu Univ Technol, Shandong Acad Sci, Sch Math & Stat, Jinan, Shandong, Peoples R China
[2] Shandong Univ Aeronaut, Coll Sci, Binzhou, Shandong, Peoples R China
[3] Shandong Univ Aeronaut, Coll Sci, 391 Huanghe 5 Rd, Binzhou 256600, Shandong, Peoples R China
基金
中国国家自然科学基金;
关键词
leader-follower consensus; multiple robot manipulator; neural network; optimal control; reinforcement learning; sliding mode variable; TRACKING CONTROL;
D O I
10.1002/rnc.7259
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article is to develop an optimized leader-follower consensus control for multiple robot manipulator system by combining sliding mode control (SMC) and reinforcement learning (RL). The SMC mechanism aims to steer both position and velocity states of multiple manipulator reaching the predefined trajectory. And the RL is designed and performed under identifier-critic-actor architecture for the achievement of optimized control performance. Compared to traditional optimal control, this proposed method has two main advantages: (i) the RL updating laws for training both the actor and critic networks are simpler; (ii) the optimized control can not require the complete dynamic knowledge because the adaptive identifier is designed into the RL learning. Consequently, this optimized control method can smoothly steer the multiple robot manipulator system to achieve the leader-follower consensus. Finally, feasibility of this control method is verified through both theory and simulation.
引用
收藏
页码:5212 / 5228
页数:17
相关论文
共 38 条
  • [1] Simplified optimized finite-time containment control for a class of multi-agent systems with actuator faults
    Cui, Jingpeng
    Pan, Yingnan
    Xue, Hong
    Tan, Lihua
    [J]. NONLINEAR DYNAMICS, 2022, 109 (04) : 2799 - 2816
  • [2] Global exponential synchronization of discrete-time high-order switched neural networks and its application to multi-channel audio encryption
    Dong, Zeyu
    Wang, Xin
    Zhang, Xian
    Hu, Mengjie
    Dinh, Thach Ngoc
    [J]. NONLINEAR ANALYSIS-HYBRID SYSTEMS, 2023, 47
  • [3] Adaptive neural control of uncertain MIMO nonlinear systems
    Ge, SS
    Wang, C
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2004, 15 (03): : 674 - 692
  • [4] Reinforcement Learning Tracking Control for Robotic Manipulator With Kernel-Based Dynamic Model
    Hu, Yazhou
    Wang, Wenxue
    Liu, Hao
    Liu, Lianqing
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (09) : 3570 - 3578
  • [5] NN-based reinforcement-learning optimal sliding mode control for drag-free and attitude of spacecraft with state constraints
    Jiang, Changwu
    Liu, Yuan
    [J]. ADVANCES IN SPACE RESEARCH, 2024, 73 (01) : 971 - 981
  • [6] Practical Nonsingular Terminal Sliding-Mode Control of Robot Manipulators for High-Accuracy Tracking Control
    Jin, Maolin
    Lee, Jinoh
    Chang, Pyung Hun
    Choi, Chintae
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2009, 56 (09) : 3593 - 3601
  • [7] Multiobjective Rule-Based Cooperative Continuous Ant Colony Optimized Fuzzy Systems With a Robot Control Application
    Juang, Chia-Feng
    Lin, Chan-Hung
    Bui, Trong Bac
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (02) : 650 - 663
  • [8] Kawai H, 2011, IEEE INTL CONF CONTR, P1451, DOI 10.1109/CCA.2011.6044445
  • [9] Lewis F. L., 2012, Optimal Control, DOI 10.1002/9781118122631
  • [10] Consensus of Nonlinear Multiagent Systems With Uncertainties Using Reinforcement Learning Based Sliding Mode Control
    Li, Jinna
    Yuan, Lin
    Chai, Tianyou
    Lewis, Frank L.
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2023, 70 (01) : 424 - 434