Discrete-time mean-field Stochastic linear-quadratic optimal control problems, II: Infinite horizon case

被引:68
|
作者
Ni, Yuan-Hua [1 ,2 ]
Elliott, Robert [3 ,4 ]
Li, Xun [5 ]
机构
[1] Tianjin Polytech Univ, Sch Sci, Dept Math, Tianjin 300160, Peoples R China
[2] Chinese Acad Sci, Acad Math & Syst Sci, Key Lab Syst & Control, Beijing 100190, Peoples R China
[3] Univ Adelaide, Sch Math Sci, Adelaide, SA 5005, Australia
[4] Univ Calgary, Haskayne Sch Business, Calgary, AB, Canada
[5] Hong Kong Polytech Univ, Dept Appl Math, Kowloon, Hong Kong, Peoples R China
基金
加拿大自然科学与工程研究理事会; 澳大利亚研究理事会; 中国国家自然科学基金; 中国博士后科学基金;
关键词
Stochastic linear quadratic optimal control; Mean-field theory; Generalized algebraic Riccati equation; DIFFERENTIAL-EQUATIONS; MAXIMUM PRINCIPLE; SYSTEMS;
D O I
10.1016/j.automatica.2015.04.002
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper first presents results on the equivalence of several notions of L-2-stability for linear mean-field stochastic difference equations with random initial value. Then, it is shown that the optimal control of a mean-field linear quadratic optimal control with an infinite time horizon uniquely exists, and the optimal control can be expressed as a linear state feedback involving the state and its mean, via the minimal nonnegative definite solution of two coupled algebraic Riccati equations. As a byproduct, the open-loop L-2-stabilizability is proved to be equivalent to the closed-loop L-2-stabilizability. Moreover, the minimal nonnegative definite solution, the maximal solution, the stabilizing solution of the algebraic Riccati equations and their relations are carefully investigated. Specifically, it is shown that the maximal solution is employed to construct the optimal control and value function to another infinite time horizon mean-field linear quadratic optimal control. In addition, the maximal solution being the stabilizing solution, is completely characterized by properties of the coefficients of the controlled system. This enriches the existing theory about stochastic algebraic Riccati equations. Finally, the notion of exact detectability is introduced with its equivalent characterization of stochastic versions of the Popov-Belevitch-Hautus criteria. It is then shown that the minimal nonnegative definite solution is the stabilizing solution if and only if the uncontrolled system is exactly detectable. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:65 / 77
页数:13
相关论文
共 50 条
  • [1] Discrete-time mean-field stochastic linear-quadratic optimal control problem with finite horizon
    Song, Teng
    Liu, Bin
    ASIAN JOURNAL OF CONTROL, 2021, 23 (02) : 979 - 989
  • [2] Discrete time mean-field stochastic linear-quadratic optimal control problems
    Elliott, Robert
    Li, Xun
    Ni, Yuan-Hua
    AUTOMATICA, 2013, 49 (11) : 3222 - 3233
  • [3] A discrete-time mean-field stochastic linear-quadratic optimal control problem with financial application
    Li, Xun
    Tai, Allen H.
    Tian, Fei
    INTERNATIONAL JOURNAL OF CONTROL, 2021, 94 (01) : 175 - 189
  • [4] Indefinite Mean-Field Stochastic Linear-Quadratic Optimal Control: From Finite Horizon to Infinite Horizon
    Ni, Yuan-Hua
    Li, Xun
    Zhang, Ji-Feng
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2016, 61 (11) : 3269 - 3284
  • [5] A LINEAR-QUADRATIC OPTIMAL CONTROL PROBLEM FOR MEAN-FIELD STOCHASTIC DIFFERENTIAL EQUATIONS IN INFINITE HORIZON
    Huang, Jianhui
    Li, Xun
    Yong, Jiongmin
    MATHEMATICAL CONTROL AND RELATED FIELDS, 2015, 5 (01) : 97 - 139
  • [6] Mean-field linear-quadratic stochastic differential games in an infinite horizon
    Li, Xun
    Shi, Jingtao
    Yong, Jiongmin
    ESAIM-CONTROL OPTIMISATION AND CALCULUS OF VARIATIONS, 2021, 27
  • [7] Linear-Quadratic Optimal Control for Discrete-Time Mean-Field Systems With Input Delay
    Qi, Qingyuan
    Xie, Lihua
    Zhang, Huanshui
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2022, 67 (08) : 3806 - 3821
  • [8] Finite-Horizon Indefinite Mean-Field Stochastic Linear-Quadratic Optimal Control
    Ni, Yuan-Hua
    Li, Xun
    Zhang, Ji-Feng
    IFAC PAPERSONLINE, 2015, 48 (28): : 211 - 216
  • [9] INFINITE HORIZON LINEAR QUADRATIC OPTIMAL CONTROL FOR DISCRETE-TIME STOCHASTIC SYSTEMS
    Huang, Yulin
    Zhang, Weihai
    Zhang, Huanshui
    ASIAN JOURNAL OF CONTROL, 2008, 10 (05) : 608 - 615
  • [10] LINEAR-QUADRATIC OPTIMAL CONTROL PROBLEMS FOR MEAN-FIELD STOCHASTIC DIFFERENTIAL EQUATIONS
    Yong, Jiongmin
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2013, 51 (04) : 2809 - 2838