Stability Analysis for State Feedback Control Systems Established as Neural Networks with Input Constraints

被引:0
作者
Markolf, Lukas [1 ]
Stursberg, Olaf [1 ]
机构
[1] Univ Kassel, Dept Elect Engn & Comp Sci, Control & Syst Theory, Wilhelmshoher Allee 73, D-34121 Kassel, Germany
来源
PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON INFORMATICS IN CONTROL, AUTOMATION AND ROBOTICS (ICINCO) | 2021年
关键词
Constrained Control; Intelligent Control; Neural Networks; Reinforcement Learning; Stability; FEEDFORWARD NETWORKS;
D O I
10.5220/0010548801460155
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Considerable progress in deep learning has also lead to an increasing interest in using deep neural networks (DNN) for state feedback in closed-loop control systems. In contrast to other purposes of DNN, it is insufficient to consider them only as black box models in control, in particular, when used for safety-critical applications. This paper provides an approach allowing to use the well-established indirect method of Lyapunov for time-invariant continuous time nonlinear systems with neural networks as state feedback controllers in the loop. A key element hereto is the derivation of a closed-form expression for the partial derivative of the neural network controller with respect to its input. By using activation functions of the type of sigmoid functions in the output layer, the consideration of box-constrained inputs is further ensured. The proposed approach does not only allow to verify the asymptotic stability, but also to find Lyapunov functions which can be used to search for positively invariant sets and estimates for the region of attraction.
引用
收藏
页码:146 / 155
页数:10
相关论文
共 28 条
[1]   DYNAMIC PROGRAMMING [J].
BELLMAN, R .
SCIENCE, 1966, 153 (3731) :34-&
[2]  
Bertsekas D. P., 1996, Neuro-dynamic Programming
[3]  
Blanchini F, 2008, SYST CONTROL-FOUND A, P1
[4]  
Chang Y.-C., 2020, NEURIPS
[5]  
Cybenko G., 1989, Mathematics of Control, Signals, and Systems, V2, P303, DOI 10.1007/BF02551274
[6]   Reachability Analysis for Neural Feedback Systems using Regressive Polynomial Rule Inference [J].
Dutta, Souradeep ;
Chen, Xin ;
Sankaranarayanan, Sriram .
PROCEEDINGS OF THE 2019 22ND ACM INTERNATIONAL CONFERENCE ON HYBRID SYSTEMS: COMPUTATION AND CONTROL (HSCC '19), 2019, :157-168
[7]   Output Range Analysis for Deep Feedforward Neural Networks [J].
Dutta, Souradeep ;
Jha, Susmit ;
Sanakaranarayanan, Sriram ;
Tiwari, Ashish .
NASA FORMAL METHODS, NFM 2018, 2018, 10811 :121-138
[8]  
Fazlyab M, 2019, ADV NEUR IN, V32
[9]   Safety Verification and Robustness Analysis of Neural Networks via Quadratic Constraints and Semidefinite Programming [J].
Fazlyab, Mahyar ;
Morari, Manfred ;
Pappas, George J. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2022, 67 (01) :1-15
[10]  
Goodfellow I, 2016, Deep Learning, DOI DOI 10.2172/1462436