Optimal tracking control for discrete-time modal persistent dwell time switched systems based on Q-learning

被引:1
作者
Zhang, Xuewen [1 ]
Wang, Yun [1 ]
Xia, Jianwei [2 ]
Li, Feng [1 ]
Shen, Hao [1 ]
机构
[1] Anhui Univ Technol, Sch Elect & Informat Engn, Maanshan 243002, Peoples R China
[2] Liaocheng Univ, Sch Math Sci, Liaocheng, Peoples R China
基金
中国国家自然科学基金;
关键词
linear quadratic tracking control; modal persistent dwell time; Q-learning; switched systems; ADAPTIVE OPTIMAL-CONTROL; LINEAR-SYSTEMS; STABILITY ANALYSIS; SYNCHRONIZATION; STABILIZATION; NETWORKS; DESIGN; SCHEME;
D O I
10.1002/oca.3040
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Based on the Q-learning, this paper investigates the tracking problem for linear discrete-time modal persistent dwell time switched systems. The modal persistent dwell time switching rule is introduced to coordinate the switching conditions of each switching subsystems. Moreover, two algorithms are given to realize the optimization of switched systems. Then, the stability and convergence are proved. Finally, a numerical simulation example and a practical example with an electro-hydraulic system are given to verify the effectiveness of the proposed approach.
引用
收藏
页码:3327 / 3341
页数:15
相关论文
共 45 条
[1]   Adaptive hybrid synchronisation in uncertain Kuramoto networks with limited information [J].
Baldi, Simone ;
Tao, Tian ;
Kosmatopoulos, Elias B. .
IET CONTROL THEORY AND APPLICATIONS, 2019, 13 (09) :1229-1238
[2]   Infinite horizon linear quadratic tracking problem: A discounted cost function approach [J].
Birgani, Soleiman Najafi ;
Moaveni, Bijan ;
Khaki-Sedigh, Ali .
OPTIMAL CONTROL APPLICATIONS & METHODS, 2018, 39 (04) :1549-1572
[3]   Modal and transition dwell time computation in switching systems: A set-theoretic approach [J].
Blanchini, Franco ;
Casagrande, Daniele ;
Miani, Stefano .
AUTOMATICA, 2010, 46 (09) :1477-1482
[4]   Multiple Lyapunov functions and other analysis tools for switched and hybrid systems [J].
Branicky, MS .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1998, 43 (04) :475-482
[5]   Optimal synchronization controller design for complex dynamical networks with unknown system dynamics [J].
Cao, Ya-Wei ;
Yang, Guang-Hong ;
Li, Xiao-Jian .
JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2019, 356 (12) :6071-6086
[6]   Guidance and control laws design for a switched system with discontinuous actuators [J].
Chen, Jian ;
Liang, Zixuan ;
Bai, Chen ;
Li, Peng ;
Ren, Zhang ;
Zheng, Yongjun .
OPTIMAL CONTROL APPLICATIONS & METHODS, 2017, 38 (05) :829-846
[7]   Stochastic model predictive control for tracking linear systems [J].
D'Jorge, Agustina ;
Santoro, Bruno F. ;
Anderson, Alejandro ;
Gonzalez, Alejandro H. ;
Ferramosca, Antonio .
OPTIMAL CONTROL APPLICATIONS & METHODS, 2020, 41 (01) :65-83
[8]   Stability analysis and control synthesis for switched systems: A switched Lyapunov function approach [J].
Daafouz, J ;
Riedinger, P ;
Iung, C .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2002, 47 (11) :1883-1887
[9]   Optimal control of unknown affine nonlinear discrete-time systems using offline-trained neural networks with proof of convergence [J].
Dierks, Travis ;
Thumati, Balaje T. ;
Jagannathan, S. .
NEURAL NETWORKS, 2009, 22 (5-6) :851-860
[10]   Q-learning algorithm in solving consensusability problem of discrete-time multi-agent systems [J].
Feng, Tao ;
Zhang, Jilie ;
Tong, Yin ;
Zhang, Huaguang .
AUTOMATICA, 2021, 128