H∞ Consensus for Discrete-Time Fractional-Order Multi-Agent Systems With Disturbance via Q-Learning in Zero-Sum Games

被引:13
作者
An, Chunlan [1 ]
Su, Housheng [2 ]
Chen, Shiming [1 ]
机构
[1] East China Jiaotong Univ, Sch Elect & Automat Engn, Nanchang 330013, Jiangxi, Peoples R China
[2] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Wuhan 430074, Peoples R China
来源
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING | 2022年 / 9卷 / 04期
基金
中国国家自然科学基金;
关键词
H-infinity consensus; discrete-time fractional-order multi-agent systems; feedback control with memory; zero-sum games; Q-learning; OUTPUT-FEEDBACK; CONTROLLER-DESIGN;
D O I
10.1109/TNSE.2022.3169792
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
This paper investigates H-infinity consensus problem for discrete-time fractional-order multi-agent systems (DTFOMASs) with external disturbance in both state and output feedback controls. Based on the short-memory principle, the original DTFOMASs are transformed into classical discrete-time systems. Then, two consensus protocols with finite-dimensional memory for state and output feedback are proposed. By using the Bellman equation approach and recursive least-squares, two Q-learning (QL) algorithms for two-player zero-sum games (ZSG) to H-infinity control are presented to learn the optimal feedback gain matrices without any information from the system dynamics and network topology. Furthermore, the DTFOMASs with external disturbance can achieve H-infinity state and output consensus under the two proposed protocols, respectively. In the end, two real scenarios of high-speed train running on the railway section of "Zhengzhou-Wuhan" are applied to check the validity of the proposed approaches.
引用
收藏
页码:2803 / 2814
页数:12
相关论文
共 33 条
  • [1] Model-free Q-learning designs for linear discrete-time zero-sum games with application to H-infinity control
    Al-Tamimi, Asma
    Lewis, Frank L.
    Abu-Khalaf, Murad
    [J]. AUTOMATICA, 2007, 43 (03) : 473 - 481
  • [2] Finite-dimensional control of linear discrete-time fractional-order systems
    Alessandretti, Andrea
    Pequito, Sergio
    Pappas, George J.
    Aguiar, A. Pedro
    [J]. AUTOMATICA, 2020, 115
  • [3] Chen C., 2020, IEEE ACCESS, V8, P2169
  • [4] H∞ Scaled Consensus for MASs With Mixed Time Delays and Disturbances via Observer-Based Output Feedback
    Chen, Shiming
    Zhang, Zheng
    Zheng, Yuanshi
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (02) : 1321 - 1334
  • [5] Multitarget Tracking Control for Coupled Heterogeneous Inertial Agents Systems Based on Flocking Behavior
    Chen, Shiming
    Pei, Huiqin
    Lai, Qiang
    Yan, Huaicheng
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2019, 49 (12): : 2605 - 2611
  • [6] Periodically time-varying memory state-feedback controller synthesis for discrete-time linear systems
    Ebihara, Yoshio
    Peaucelle, Dimitri
    Arzelier, Denis
    [J]. AUTOMATICA, 2011, 47 (01) : 14 - 25
  • [7] Kaczorek T, 2011, LECT NOTES CONTR INF, V411, P1, DOI 10.1007/978-3-642-20502-6
  • [8] Robust Consensus of Linear Feedback Protocols Over Uncertain Network Graphs
    Li, Zhongkui
    Chen, Jie
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2017, 62 (08) : 4251 - 4258
  • [9] Necessary and sufficient graphical conditions for formation control of unicycles
    Lin, ZY
    Francis, B
    Maggiore, M
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2005, 50 (01) : 121 - 127
  • [10] Event-Based H∞ Consensus Control of Multi-Agent Systems With Relative Output Feedback: The Finite-Horizon Case
    Liu, Qinyuan
    Wang, Zidong
    He, Xiao
    Zhou, D. H.
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2015, 60 (09) : 2553 - 2558