Expected value based optimal control for discrete-time stochastic noncausal systems

被引:8
|
作者
Shu, Yadong [1 ,2 ]
Li, Bo [1 ,2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Math & Stat, Nanjing 210044, Peoples R China
[2] Nanjing Univ Finance & Econ, Sch Appl Math, Nanjing 210023, Peoples R China
关键词
Optimal control; Stochastic noncausal system; Recurrence equation; Quadratic input; NONLINEAR-SYSTEMS; STABILITY; MULTISTAGE;
D O I
10.1007/s11590-021-01807-z
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In this paper, optimal control models subject to two types of discrete-time stochastic noncausal systems are considered in order. The stochastic noncausal systems are stochastic singular systems assumed to be regular alone. Based on the principle of dynamic programming, a recurrence equation is deduced to simplify the optimal control models. Then, by applying the recurrence equation, a bang-bang optimal control problem ruled by a linear stochastic noncausal system and an optimal control problem for a stochastic noncausal system with quadratic inputs are both solved, and the optimal solutions are presented through analytical expressions. A numerical example is provided to illustrate the effectiveness of the results about the bang-bang optimal control problem.
引用
收藏
页码:1847 / 1879
页数:33
相关论文
共 50 条
  • [21] A maximum principle for optimal control of discrete-time stochastic systems with Markov jump
    Lin X.-Y.
    Wang X.-R.
    Zhang W.-H.
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2024, 41 (05): : 895 - 904
  • [22] Nonlinear-nonquadratic optimal and inverse optimal control for discrete-time stochastic dynamical systems
    Lanchares, Manuel
    Haddad, Wassim M.
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2022, 32 (03) : 1487 - 1509
  • [23] Stochastic linear quadratic optimal tracking control for discrete-time systems with delays based on Q-learning algorithm
    Tan, Xufeng
    Li, Yuan
    Liu, Yang
    AIMS MATHEMATICS, 2023, 8 (05): : 10249 - 10265
  • [24] Event-based security control for discrete-time stochastic systems
    Ding, Derui
    Wang, Zidong
    Wei, Guoliang
    Alsaadi, Fuad E.
    IET CONTROL THEORY AND APPLICATIONS, 2016, 10 (15) : 1808 - 1815
  • [25] Optimal Control of Linear Discrete-Time Systems with Quantization Effects
    Su, Weizhou
    Chen, Jie
    Fu, Minyue
    Qi, Tian
    Wu, Yilin
    26TH CHINESE CONTROL AND DECISION CONFERENCE (2014 CCDC), 2014, : 2582 - 2587
  • [26] DETERMINISTIC AND STOCHASTIC CONTROL OF DISCRETE-TIME BILINEAR SYSTEMS
    SWAMY, KN
    TARN, TJ
    AUTOMATICA, 1979, 15 (06) : 677 - 682
  • [27] Optimal Covariance Steering for Discrete-Time Linear Stochastic Systems
    Liu, Fengjiao
    Rapakoulias, George
    Tsiotras, Panagiotis
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2025, 70 (04) : 2289 - 2304
  • [28] Isoperimetric Constraint Inference for Discrete-Time Nonlinear Systems Based on Inverse Optimal Control
    Wei, Qinglai
    Li, Tao
    Zhang, Jie
    Li, Hongyang
    Wang, Xin
    Xiao, Jun
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (09) : 5493 - 5505
  • [29] Composite hierarchical antidisturbance control for a class of discrete-time stochastic systems
    Wei, Xinjiang
    Zhang, Huifeng
    Sun, Shixiang
    Karimi, Hamid Reza
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2018, 28 (09) : 3292 - 3302
  • [30] Contraction Analysis of Discrete-Time Stochastic Systems
    Kawano, Yu
    Hosoe, Yohei
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2024, 69 (02) : 982 - 997