Reinforcement learning and adaptive optimization of a class of Markov jump systems with completely unknown dynamic information

被引:0
|
作者
Shuping He
Maoguang Zhang
Haiyang Fang
Fei Liu
Xiaoli Luan
Zhengtao Ding
机构
[1] Anhui University,School of Electrical Engineering and Automation
[2] Anhui University,Institute of Physical Science and Information Technology
[3] Jiangnan University,Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), Institute of Automation
[4] The University of Manchester,School of Electrical and Electronic Engineering
来源
Neural Computing and Applications | 2020年 / 32卷
关键词
Markov jump linear systems (MJLSs); Adaptive optimal control; Online; Reinforcement learning (RL); Coupled algebraic Riccati equations (AREs);
D O I
暂无
中图分类号
学科分类号
摘要
In this paper, an online adaptive optimal control problem of a class of continuous-time Markov jump linear systems (MJLSs) is investigated by using a parallel reinforcement learning (RL) algorithm with completely unknown dynamics. Before collecting and learning the subsystems information of states and inputs, the exploration noise is firstly added to describe the actual control input. Then, a novel parallel RL algorithm is used to parallelly compute the corresponding N coupled algebraic Riccati equations by online learning. By this algorithm, we will not need to know the dynamic information of the MJLSs. The convergence of the proposed algorithm is also proved. Finally, the effectiveness and applicability of this novel algorithm is illustrated by two simulation examples.
引用
收藏
页码:14311 / 14320
页数:9
相关论文
共 50 条
  • [11] Adaptive Optimal Consensus Control of Multiagent Systems With Unknown Dynamics and Disturbances via Reinforcement Learning
    Chen L.
    Dong C.
    Dai S.-L.
    IEEE Transactions on Artificial Intelligence, 2024, 5 (05): : 2193 - 2203
  • [12] A Fuzzy-Model-Based Approach to Optimal Control for Nonlinear Markov Jump Singularly Perturbed Systems: A Novel Integral Reinforcement Learning Scheme
    Shen, Hao
    Wang, Yun
    Wang, Jing
    Park, Ju H.
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2023, 31 (10) : 3734 - 3740
  • [13] Reinforcement Learning-Based R ∞ Control of 2-D Markov Jump Roesser Systems With Optimal Disturbance Attenuation
    Wu, Jiacheng
    Lian, Bosen
    Su, Hongye
    Zhu, Yang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [14] Adaptive FPGA Placement Optimization via Reinforcement Learning
    Murray, Kevin E.
    Betz, Vaughn
    2019 ACM/IEEE 1ST WORKSHOP ON MACHINE LEARNING FOR CAD (MLCAD), 2019,
  • [15] Parallel Control for Nonzero-Sum Games With Completely Unknown Nonlinear Dynamics via Reinforcement Learning
    Lu, Jingwei
    Wei, Qinglai
    Wang, Fei-Yue
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2025,
  • [16] NN Reinforcement Learning Adaptive Control for a Class of Nonstrict-Feedback Discrete-Time Systems
    Bai, Weiwei
    Li, Tieshan
    Tong, Shaocheng
    IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (11) : 4573 - 4584
  • [17] A stabilizing reinforcement learning approach for sampled systems with partially unknown models
    Beckenbach, Lukas
    Osinenko, Pavel
    Streif, Stefan
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2024, 34 (18) : 12389 - 12412
  • [18] Computational adaptive optimal control for continuous-time linear systems with completely unknown dynamics
    Jiang, Yu
    Jiang, Zhong-Ping
    AUTOMATICA, 2012, 48 (10) : 2699 - 2704
  • [19] Reinforcement Learning based Adaptive Access Class Barring for RAN Slicing
    Turan, Ali
    Koseoglu, Mehmet
    Sezer, Ebru Akcapinar
    2021 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2021,
  • [20] Integral Reinforcement Learning for Linear Continuous-Time Zero-Sum Games With Completely Unknown Dynamics
    Li, Hongliang
    Liu, Derong
    Wang, Ding
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2014, 11 (03) : 706 - 714