Generalized Coupled Algebraic Riccati Equations for Discrete-time Markov Jump with Multiplicative Noise Systems

被引:21
作者
do Valle Costa, Oswaldo Luiz [1 ]
de Paulo, Wanderlei L. [1 ]
机构
[1] Univ Sao Paulo, Escola Politecn, Dept Engn Telecommun & Controle, BR-05508900 Sao Paulo, Brazil
关键词
Indefinite stochastic control; multiplicative noise; Markov jumps; generalized coupled algebraic Riccati equations; maximal solution; stabilizing solution;
D O I
10.3166/EJC.14.391-408
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper we consider the existence of the maximal and mean square stabilizing solutions for a set of generalized coupled algebraic Riccati equations (GCARE for short) associated to the infinite-horizon stochastic optimal control problem of discrete-time Markov jump with multiplicative noise linear systems. The weighting matrices of the state and control for the quadratic part are allowed to be indefinite. We present a sufficient condition, based only on some positive semi-definite and kernel restrictions on some matrices, under which there exists the maximal solution and a necessary and sufficient condition under which there exists the mean square stabilizing solution fir the GCARE. We also present a solution for the discounted and long run average cost problems when the performance criterion is assumed be composed by a linear combination of an indefinite quadratic part and a linear part in the state and control variables. The paper is concluded with a numerical example for pension fund with regime switching.
引用
收藏
页码:391 / 408
页数:18
相关论文
共 47 条
[1]   ON THE SOLUTION OF DISCRETE-TIME MARKOVIAN JUMP LINEAR-QUADRATIC CONTROL-PROBLEMS [J].
ABOUKANDIL, H ;
FREILING, G ;
JANK, G .
AUTOMATICA, 1995, 31 (05) :765-768
[2]   Portfolio optimization with Markov-modulated stock prices and interest rates [J].
Bäuerle, N ;
Rieder, U .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2004, 49 (03) :442-447
[3]   Discrete-time optimal control with control-dependent noise and generalized Riccati difference equations [J].
Beghi, A ;
D'Alessandro, D .
AUTOMATICA, 1998, 34 (08) :1031-1034
[4]  
Boy S., 1994, Linear MatrixInequalities in System and Control Theory
[5]   Portfolio optimization in stochastic markets [J].
Çakmak, U ;
Özekici, S .
MATHEMATICAL METHODS OF OPERATIONS RESEARCH, 2006, 63 (01) :151-168
[6]   Stochastic linear quadratic regulators with indefinite control weight costs [J].
Chen, SP ;
Li, XJ ;
Zhou, XY .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1998, 36 (05) :1685-1702
[7]   Weak detectability and the linear-quadratic control problem of discrete-time Markov jump linear systems [J].
Costa, EF ;
Do Val, JBR .
INTERNATIONAL JOURNAL OF CONTROL, 2002, 75 (16-17) :1282-1292
[8]  
Costa O.L.V., 2005, PROBABILITY ITS APPL
[9]  
Costa O.L.V., 1996, J MATH SYST EST CONT, V6, P1
[10]   Maximal and stabilizing Hermitian solutions for discrete-time coupled algebraic Riccati equations [J].
Costa, OLV ;
Marques, RP .
MATHEMATICS OF CONTROL SIGNALS AND SYSTEMS, 1999, 12 (02) :167-195