Optimal tracking control for discrete-time modal persistent dwell time switched systems based on Q-learning

被引:1
|
作者
Zhang, Xuewen [1 ]
Wang, Yun [1 ]
Xia, Jianwei [2 ]
Li, Feng [1 ]
Shen, Hao [1 ]
机构
[1] Anhui Univ Technol, Sch Elect & Informat Engn, Maanshan 243002, Peoples R China
[2] Liaocheng Univ, Sch Math Sci, Liaocheng, Peoples R China
来源
OPTIMAL CONTROL APPLICATIONS & METHODS | 2023年 / 44卷 / 06期
基金
中国国家自然科学基金;
关键词
linear quadratic tracking control; modal persistent dwell time; Q-learning; switched systems; ADAPTIVE OPTIMAL-CONTROL; LINEAR-SYSTEMS; STABILITY ANALYSIS; SYNCHRONIZATION; STABILIZATION; NETWORKS; DESIGN; SCHEME;
D O I
10.1002/oca.3040
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Based on the Q-learning, this paper investigates the tracking problem for linear discrete-time modal persistent dwell time switched systems. The modal persistent dwell time switching rule is introduced to coordinate the switching conditions of each switching subsystems. Moreover, two algorithms are given to realize the optimization of switched systems. Then, the stability and convergence are proved. Finally, a numerical simulation example and a practical example with an electro-hydraulic system are given to verify the effectiveness of the proposed approach.
引用
收藏
页码:3327 / 3341
页数:15
相关论文
共 50 条
  • [1] An Optimal Tracking Control Method with Q-learning for Discrete-time Linear Switched System
    Zhao, Shangwei
    Wang, Jingcheng
    Wang, Hongyuan
    Xu, Haotian
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 1414 - 1419
  • [2] Reinforcement Q-learning for optimal tracking control of linear discrete-time systems with unknown dynamics
    Kiumarsi, Bahare
    Lewis, Frank L.
    Modares, Hamidreza
    Karimpour, Ali
    Naghibi-Sistani, Mohammad-Bagher
    AUTOMATICA, 2014, 50 (04) : 1167 - 1175
  • [3] Discrete-Time Optimal Control Scheme Based on Q-Learning Algorithm
    Wei, Qinglai
    Liu, Derong
    Song, Ruizhuo
    2016 SEVENTH INTERNATIONAL CONFERENCE ON INTELLIGENT CONTROL AND INFORMATION PROCESSING (ICICIP), 2016, : 125 - 130
  • [4] Stochastic linear quadratic optimal tracking control for discrete-time systems with delays based on Q-learning algorithm
    Tan, Xufeng
    Li, Yuan
    Liu, Yang
    AIMS MATHEMATICS, 2023, 8 (05): : 10249 - 10265
  • [5] An ADDHP-based Q-learning algorithm for optimal tracking control of linear discrete-time systems with unknown dynamics
    Mu, Chaoxu
    Zhao, Qian
    Sun, Changyin
    Gao, Zhongke
    APPLIED SOFT COMPUTING, 2019, 82
  • [6] Fault Detection for Nonlinear Discrete-Time Switched Systems With Persistent Dwell Time
    Du, Dongsheng
    Xu, Shengyuan
    Cocquempot, Vincent
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2018, 26 (04) : 2466 - 2474
  • [7] Optimal trajectory tracking for uncertain linear discrete-time systems using time-varying Q-learning
    Geiger, Maxwell
    Narayanan, Vignesh
    Jagannathan, Sarangapani
    INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2024, 38 (07) : 2340 - 2368
  • [8] Reinforcement Q-learning and Optimal Tracking Control of Unknown Discrete-time Multi-player Systems Based on Game Theory
    Zhao, Jin-Gang
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2024, 22 (05) : 1751 - 1759
  • [9] Dwell time based stabilisability criteria for discrete-time switched systems
    She, Zhikun
    Lu, Junjie
    Liang, Quanyi
    Ge, Shuzhi Sam
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2017, 48 (14) : 3087 - 3097
  • [10] Reinforcement Q-learning algorithm for H∞ tracking control of discrete-time Markov jump systems
    Shi, Jiahui
    He, Dakuo
    Zhang, Qiang
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2025, 56 (03) : 502 - 523