Output-feedback robust control of systems with uncertain dynamics via data-driven policy learning

被引:9
作者
Zhao, Jun [1 ]
Lv, Yongfeng [2 ]
机构
[1] Shandong Univ Sci & Technol, Coll Mech & Elect Engn, Qingdao, Peoples R China
[2] Taiyuan Univ Technol, Coll Elect & Power Engn, Taiyuan, Peoples R China
基金
中国国家自然科学基金;
关键词
input-output information; optimal control; output-feedback robust control; policy learning; TIME LINEAR-SYSTEMS; NONLINEAR-SYSTEMS; STABILIZATION; CONVERGENCE; ALGORITHM;
D O I
10.1002/rnc.6374
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, we develop two online learning techniques to address the output-feedback robust control problem of systems with uncertain dynamics. For this purpose, an equivalence is first constructed between the robust control problem of the uncertain systems and the optimal control problem of the nominal systems. Then, an output algebraic Riccati equation (OARE) is constructed using its state-feedback control counterpart, which can be adopted to realize the online learning. To obtain the online solution of the OARE, an online policy learning (PL) algorithm based on the state reconstruction (SR) is first presented, where the unknown system internal states can be reconstructed via using the input-output information. To further relax the requirement on the system internal states, a novel online PL method is designed, where only the system output information is required, thus the observer or SR is removed in this online PL algorithm. Simulations are provided to test the developed online learning methods.
引用
收藏
页码:9791 / 9807
页数:17
相关论文
共 50 条
  • [31] Willems' Fundamental Lemma for Linear Descriptor Systems and Its Use for Data-Driven Output-Feedback MPC
    Schmitz, Philipp
    Faulwasser, Timm
    Worthmann, Karl
    IEEE CONTROL SYSTEMS LETTERS, 2022, 6 : 2443 - 2448
  • [32] Robust adaptive output feedback control for uncertain nonlinear systems
    Yang, Qiang
    Liu, Yu-Sheng
    Kongzhi yu Juece/Control and Decision, 2015, 30 (06): : 993 - 999
  • [33] Adaptive output-feedback control of a general class of uncertain feedforward systems via a dynamic scaling approach
    Krishnamurthy, P.
    Khorrami, F.
    IET CONTROL THEORY AND APPLICATIONS, 2011, 5 (05) : 681 - 692
  • [34] Data-driven Control of Unknown Linear Systems via Quantized Feedback
    Zhao, Feiran
    Li, Xingchen
    You, Keyou
    LEARNING FOR DYNAMICS AND CONTROL CONFERENCE, VOL 168, 2022, 168
  • [35] Universal adaptive control for uncertain nonlinear systems via output feedback
    Zhai, Junyong
    Karimi, Hamid Reza
    INFORMATION SCIENCES, 2019, 500 : 140 - 155
  • [36] Online accelerated data-driven learning for optimal feedback control of discrete-time partially uncertain systems
    Somers, Luke
    Haddad, Wassim M.
    Kokolakis, Nick-Marios T.
    Vamvoudakis, Kyriakos G.
    INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2024, 38 (03) : 848 - 876
  • [37] Globally Stable Adaptive Neural Network Control for Uncertain Output-Feedback Systems
    Wang, Qiufeng
    Zhang, Zhengqiang
    2021 AMERICAN CONTROL CONFERENCE (ACC), 2021, : 3697 - 3702
  • [38] Adaptive Fuzzy Output-Feedback Control with Prescribed Performance for Uncertain Nonlinear Systems
    Zhang, Lili
    Tong, Shaocheng
    Li, Yongming
    INTERNATIONAL JOURNAL OF FUZZY SYSTEMS, 2014, 16 (02) : 212 - 221
  • [39] Data-Driven $H_{∞}$ Optimal Output Feedback Control for Linear Discrete-Time Systems Based on Off-Policy Q-Learning
    Zhang, Li
    Fan, Jialu
    Xue, Wenqian
    Lopez, Victor G.
    Li, Jinna
    Chai, Tianyou
    Lewis, Frank L.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (07) : 3553 - 3567
  • [40] Globally Adaptive Neural Network Output-Feedback Control for Uncertain Nonlinear Systems
    Zhang, Zhengqiang
    Wang, Qiufeng
    Sang, Yingli
    Ge, Shuzhi Sam
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (11) : 9078 - 9087