A Novel Resilient Control Scheme for a Class of Markovian Jump Systems With Partially Unknown Information

被引:46
作者
Zhang, Kun [1 ]
Su, Rong [2 ]
Zhang, Huaguang [3 ,4 ]
机构
[1] Chinese Acad Sci, Acad Math & Syst Sci, Beijing 100190, Peoples R China
[2] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
[3] Northeastern Univ, Key Lab Synthet Automat Proc Ind, Shenyang 110819, Peoples R China
[4] Northeastern Univ, Sch Informat Sci & Engn, Shenyang 110819, Peoples R China
基金
新加坡国家研究基金会; 中国博士后科学基金;
关键词
Games; Process control; Markov processes; Game theory; Actuators; System dynamics; Heuristic algorithms; Adaptive dynamic programming; integral reinforcement learning (IRL); resilient control; zero-sum game; NETWORKED CONTROL-SYSTEMS; MULTIAGENT SYSTEMS; FUZZY-SYSTEMS; STATE; STABILIZATION; SUBJECT; SENSOR;
D O I
10.1109/TCYB.2021.3050619
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the complex practical engineering systems, many interferences and attacking signals are inevitable in industrial applications. This article investigates the reinforcement learning (RL)-based resilient control algorithm for a class of Markovion jump systems with completely unknown transition probability information. Based on the Takagi-Sugeno logical structure, the resilient control problem of the nonlinear Markovion systems is converted into solving a set of local dynamic games, where the control policy and attacking signal are considered as two rival players. Combining the potential learning and forecasting abilities, the new integral RL (IRL) algorithm is designed via system data to compute the zero-sum games without using the information of stationary transition probability. Besides, the matrices of system dynamics can also be partially unknown, and the new architecture requires less transmission and computation during the learning process. The stochastic stability of the system dynamics under the developed overall resilient control is guaranteed based on the Lyapunov theory. Finally, the designed IRL-based resilient control is applied to a typical multimode robot arm system, and implementing results demonstrate the practicality and effectiveness.
引用
收藏
页码:8191 / 8200
页数:10
相关论文
共 45 条
[1]   Discrete-time nonlinear HJB solution using approximate dynamic programming: Convergence proof [J].
Al-Tamimi, Asma ;
Lewis, Frank .
2007 IEEE INTERNATIONAL SYMPOSIUM ON APPROXIMATE DYNAMIC PROGRAMMING AND REINFORCEMENT LEARNING, 2007, :38-+
[2]   Improved adaptive resilient control against sensor and actuator attacks [J].
An, Liwei ;
Yang, Guang-Hong .
INFORMATION SCIENCES, 2018, 423 :145-156
[3]   Robust H∞ fuzzy control approach for a class of Markovian jump nonlinear systems [J].
Arrifano, Natache S. D. ;
Oliveira, Vilma A. .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2006, 14 (06) :738-754
[4]   Adaptive Dynamic Programming for Stochastic Systems With State and Control Dependent Noise [J].
Bian, Tao ;
Jiang, Yu ;
Jiang, Zhong-Ping .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2016, 61 (12) :4170-4175
[5]   Finite-Time Sliding-Mode Control of Markovian Jump Cyber-Physical Systems Against Randomly Occurring Injection Attacks [J].
Cao, Zhiru ;
Niu, Yugang ;
Song, Jun .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2020, 65 (03) :1264-1271
[6]   Random-Positioned License Plate Recognition Using Hybrid Broad Learning System and Convolutional Networks [J].
Chen, C. L. Philip ;
Wang, Bingshu .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (01) :444-456
[7]   Resilient adaptive and H∞ controls of multi-agent systems under sensor and actuator faults [J].
Chen, Ci ;
Lewis, Frank L. ;
Xie, Shengli ;
Modares, Hamidreza ;
Liu, Zhi ;
Zuo, Shan ;
Davoudi, Ali .
AUTOMATICA, 2019, 102 :19-26
[8]   Distributed Resilient Filtering for Power Systems Subject to Denial-of-Service Attacks [J].
Chen, Wei ;
Ding, Derui ;
Dong, Hongli ;
Wei, Guoliang .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2019, 49 (08) :1688-1697
[9]   A Set-Membership Approach to Event-Triggered Filtering for General Nonlinear Systems Over Sensor Networks [J].
Ding, Derui ;
Wang, Zidong ;
Han, Qing-Long .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2020, 65 (04) :1792-1799
[10]   Neural mechanisms of learning and control [J].
Doya, K ;
Kimura, H ;
Kawato, M .
IEEE CONTROL SYSTEMS MAGAZINE, 2001, 21 (04) :42-54