A Simple Proof of Indefinite Linear-Quadratic Stochastic Optimal Control With Random Coefficients

被引:16
|
作者
Moon, Jun [1 ]
Duncan, Tyrone E. [2 ]
机构
[1] Hanyang Univ, Dept Elect Engn, Seoul 04763, South Korea
[2] Univ Kansas, Dept Math, Lawrence, KS 66045 USA
基金
新加坡国家研究基金会; 美国国家科学基金会;
关键词
Optimal control; Differential equations; Symmetric matrices; Standards; Dynamic programming; Moon; Stochastic systems; Backward stochastic differential equation (BSDE); linear-quadratic (LQ) stochastic optimal control; random coefficients; stochastic Riccati differential equation (SRDE); RICCATI-EQUATIONS; SYSTEMS; STABILIZATION; SOLVABILITY; REGULATORS; RISK;
D O I
10.1109/TAC.2020.2970982
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider the indefinite linear-quadratic optimal control problem for stochastic systems with random coefficients, where the corresponding cost parameters need not be definite matrices. Although the solution to this problem was obtained previously via the stochastic maximum principle or by solving the stochastic Hamilton-Jacobi-Bellman (HJB) equation, our approach is simple and direct. Specifically, we develop a direct approach, also known as the completion of squares method, to characterize the explicit optimal solution and the optimal cost. The corresponding optimal solution is linear characterized in terms of the stochastic Riccati differential equation (SRDE) and the linear backward stochastic differential equation (BSDE). In our approach, the completion of squares method, together with the SRDE and the BSDE, allows us to construct an equivalent cost functional that is quadratic in the control u, provided that an additional positive definiteness condition in terms of the SRDE holds. Then, the optimal control and the associated cost can be obtained by eliminating the quadratic term of u in the equivalent cost functional. The additional positive definiteness condition is induced due to the indefiniteness of the cost parameters and the dependence of the control on the diffusion term. We verify the optimal solution by solving the stochastic HJB equation.
引用
收藏
页码:5422 / 5428
页数:7
相关论文
共 50 条
  • [1] Indefinite Backward Stochastic Linear-Quadratic Optimal Control Problems
    Sun, Jingrui
    Wu, Zhen
    Xiong, Jie
    ESAIM-CONTROL OPTIMISATION AND CALCULUS OF VARIATIONS, 2023, 29
  • [2] Linear-quadratic optimal control for backward stochastic differential equations with random coefficients
    Sun, Jingrui
    Wang, Hanxiao
    ESAIM-CONTROL OPTIMISATION AND CALCULUS OF VARIATIONS, 2021, 27 (27)
  • [3] Indefinite stochastic linear-quadratic optimal control problems with random jumps and related stochastic Riccati equations
    Li, Na
    Wu, Zhen
    Yu, Zhiyong
    SCIENCE CHINA-MATHEMATICS, 2018, 61 (03) : 563 - 576
  • [4] Indefinite stochastic linear-quadratic optimal control problems with random jumps and related stochastic Riccati equations
    Na Li
    Zhen Wu
    Zhiyong Yu
    Science China Mathematics, 2018, 61 : 563 - 576
  • [5] Indefinite stochastic linear-quadratic optimal control problems with random jumps and related stochastic Riccati equations
    Na Li
    Zhen Wu
    Zhiyong Yu
    Science China(Mathematics), 2018, 61 (03) : 563 - 576
  • [6] Indefinite Mean-Field Stochastic Linear-Quadratic Optimal Control
    Ni, Yuan-Hua
    Zhang, Ji-Feng
    Li, Xun
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2015, 60 (07) : 1786 - 1800
  • [7] General indefinite backward stochastic linear-quadratic optimal control problems
    Sun, Jingrui
    Wen, Jiaqiang
    Xiong, Jie
    ESAIM-CONTROL OPTIMISATION AND CALCULUS OF VARIATIONS, 2022, 28
  • [8] INDEFINITE STOCHASTIC LINEAR-QUADRATIC OPTIMAL CONTROL PROBLEMS WITH RANDOM COEFFICIENTS: CLOSED-LOOP REPRESENTATION OF OPEN-LOOP OPTIMAL CONTROLS
    Sun, Jingrui
    Xiong, Jie
    Yong, Jiongmin
    ANNALS OF APPLIED PROBABILITY, 2021, 31 (01): : 460 - 499
  • [9] LINEAR QUADRATIC OPTIMAL STOCHASTIC CONTROL WITH RANDOM COEFFICIENTS
    BISMUT, JM
    SIAM JOURNAL ON CONTROL, 1976, 14 (03): : 419 - 444
  • [10] STOCHASTIC LINEAR-QUADRATIC OPTIMAL CONTROL PROBLEMS WITH RANDOM COEFFICIENTS AND MARKOVIAN REGIME SWITCHING SYSTEM
    Wen, Jiaqiang
    Li, Xun
    Xiong, Jie
    Zhang, Xin
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2023, 61 (02) : 949 - 979