Dynamic Event-Triggered Model-Free Reinforcement Learning for Cooperative Control of Multiagent Systems

被引:0
|
作者
Wang, Ke [1 ]
Tang, Zhuo [1 ]
Mu, Chaoxu [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Power system dynamics; Event detection; Vehicle dynamics; Adaptation models; Power system stability; Heuristic algorithms; Games; Reliability; Reinforcement learning; Power system reliability; Differential graphical game; dynamic event-triggered mechanism (DETM); integral reinforcement learning (IRL); multiagent systems (MASs); neural network (NN); SYNCHRONIZATION; GAME;
D O I
10.1109/TR.2024.3485211
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, a novel model-free dynamic event-triggered adaptive learning control scheme is developed for continuous-time linear multiagent systems. This control scheme is different from model-based control scheme in the sense that prior knowledge of the system's model is not required. To further reduce transmission data, an event-triggered control policy based on static event-triggered mechanism (SETM) and dynamic event-triggered mechanism (DETM) is proposed. Compared to SETM, DETM may significantly produce larger average event intervals and maintain control performance. In addition, based on off-policy integral reinforcement learning, an adaptive iteration method is proposed with convergence proof. Numerical tests on both linear and nonlinear multiagent systems are conducted to demonstrate that the proposed scheme can guarantee learning performance and larger triggering intervals. Finally, the learning control scheme is tested on the multiarea power system, which can illustrate the reliability and practicality of this method. Specifically, the load frequency control problem of the multiarea power system is studied using three control schemes, revealing that DETM can achieve a better frequency response at the lowest information transmission rate and ensure the overall quality and reliability of the power system.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Event-Triggered Iterative Learning Containment Control of Model-Free Multiagent Systems
    Hua, Changchun
    Qiu, Yunfei
    Guan, Xinping
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (12): : 7719 - 7726
  • [2] Model-Free Event-Triggered Consensus Algorithm for Multiagent Systems Using Reinforcement Learning Method
    Long, Mingkang
    Su, Housheng
    Zeng, Zhigang
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (08): : 5212 - 5221
  • [3] Optimal Cooperative Control of Multi-Agent Systems Through Event-Triggered Model-Free Reinforcement Learning
    Mu, Chaoxu
    Tang, Zhuo
    Wang, Ke
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024,
  • [4] Model-Free Event-Triggered Optimal Containment Control for Multiagent Systems via Adaptive Dynamic Programming
    Cao, Ao
    Wang, Fuyong
    Liu, Zhongxin
    Chen, Zengqiang
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2024, 11 (03): : 1452 - 1464
  • [5] Dynamic event-triggered tracking control for model-free networked control systems
    Zhu, Lin
    Che, Wei -Wei
    Jin, Xiao-Zheng
    APPLIED MATHEMATICS AND COMPUTATION, 2022, 431
  • [6] Event-Triggered Model-Free Adaptive Control for Nonlinear Multiagent Systems Under Jamming Attacks
    Wang, Xijuan
    Hua, Changchun
    Qiu, Yunfei
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) : 14458 - 14466
  • [7] Event-Triggered Containment Control for Nonlinear Multiagent Systems via Reinforcement Learning
    Wang, Zichen
    Wang, Xin
    Zhao, Chen
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2023, 70 (08) : 2904 - 2908
  • [8] Event-Triggered Multigradient Recursive Reinforcement Learning Tracking Control for Multiagent Systems
    Bai, Weiwei
    Li, Tieshan
    Long, Yue
    Chen, C. L. Philip
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (01) : 366 - 379
  • [9] Event-Triggered Consensus Output Tracking Strategy for Multiagent Systems Utilizing Model-Free Adaptive Control
    Song, Weizhao
    Feng, Jian
    PROCEEDINGS OF 2020 IEEE 9TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE (DDCLS'20), 2020, : 224 - 229
  • [10] Event-Triggered Model-Free Adaptive Control
    Lin, Na
    Chi, Ronghu
    Huang, Biao
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (06): : 3358 - 3369