Optimal Control for A Class of Linear Stochastic Impulsive Systems with Partially Unknown Information

被引:0
作者
Wu, Yan [1 ]
Luo, Shixian [1 ]
机构
[1] Guangxi Univ, Sch Elect Engn, Nanning, Peoples R China
来源
2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC | 2023年
基金
中国国家自然科学基金;
关键词
optimal control; stochastic impulsive system; reinforcement learning control;
D O I
10.1109/CCDC58219.2023.10327310
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper studies the optimal impulsive control problems of linear stochastic impulsive systems with periodic impulses and partially unknown information. By utilizing the collocation method combined with a periodic Lyapunov function, a sufficient condition for stochastic optimal impulsive control is derived in terms of a hybrid Riccati equation. Based on Bellman's dynamic programming principle, an online reinforcement learning algorithm is further presented to attain optimal impulsive control with partial system information. A numerical simulation illustrates the effectiveness of the proposed control method.
引用
收藏
页码:1768 / 1773
页数:6
相关论文
共 22 条
[1]  
Ahmed NU, 2001, NONLINEAR ANAL-THEOR, V47, P13
[2]   Stability analysis and stabilization of linear symmetric matrix-valued continuous, discrete, and impulsive dynamical systems - A unified approach for the stability analysis and the stabilization of linear systems [J].
Briat, Corentin .
NONLINEAR ANALYSIS-HYBRID SYSTEMS, 2022, 46
[3]  
Greene ML, 2021, P AMER CONTR CONF, P1973, DOI 10.23919/ACC50511.2021.9483047
[4]   On impulsive control of a periodically forced chaotic pendulum system [J].
Guan, ZH ;
Chen, GR ;
Ueta, T .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2000, 45 (09) :1724-1727
[5]   Optimal Impulsive Control Using Adaptive Dynamic Programming and its Application in Spacecraft Rendezvous [J].
Heydari, Ali .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (10) :4544-4552
[6]   Efficient model-based reinforcement learning for approximate online optimal control [J].
Kamalapurkar, Rushikesh ;
Rosenfeld, Joel A. ;
Dixon, Warren E. .
AUTOMATICA, 2016, 74 :247-258
[7]  
Kek S.L., 2019, Conjugate Gradient Approach for Discrete Time Optimal Control Problems with Model-Reality Differences, P81
[8]   Stochastic Linear Quadratic Optimal Control Problem: A Reinforcement Learning Method [J].
Li, Na ;
Li, Xun ;
Peng, Jing ;
Xu, Zuo Quan .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2022, 67 (09) :5009-5016
[9]   Optimal control strategy for an impulsive stochastic competition system with time delays and jumps [J].
Liu, Lidan ;
Meng, Xinzhu ;
Zhang, Tonghua .
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2017, 477 :99-113
[10]   IMPULSIVE CONTROL AND OPTIMIZATION [J].
LIU, XZ .
APPLIED MATHEMATICS AND COMPUTATION, 1995, 73 (01) :77-98