Existence of risk-sensitive optimal stationary policies for controlled Markov processes

被引:35
作者
Hernández-Hernández, D [1 ]
Marcus, SI
机构
[1] Univ Maryland, Syst Res Inst, College Pk, MD 20742 USA
[2] Univ Maryland, Dept Elect Engn, College Pk, MD 20742 USA
关键词
risk-sensitive stochastic control; dynamic games; Isaacs equation; optimal stationary policies;
D O I
10.1007/s002459900126
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper we are concerned with the existence of optimal stationary policies for infinite-horizon risk-sensitive Markov control processes with denumerable state space, unbounded cost function, and long-run average cost. Introducing a discounted cost dynamic game, we prove that its value function satisfies an Isaacs equation, and its relationship with the risk-sensitive control problem is studied. Using the vanishing discount approach, we prove that the risk-sensitive dynamic programming inequality holds, and derive an optimal stationary policy.
引用
收藏
页码:273 / 285
页数:13
相关论文
共 20 条
[11]   Risk-sensitive control of finite state machines on an infinite horizon .1. [J].
Fleming, WH ;
HernandezHernanadez, D .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1997, 35 (05) :1790-1810
[12]  
Hernandez-Lerma O., 2012, DISCRETE TIME MARKOV, V30
[13]   Risk sensitive control of Markov processes in countable state space [J].
HernandezHernandez, D ;
Marcus, SI .
SYSTEMS & CONTROL LETTERS, 1996, 29 (03) :147-155
[14]   AVERAGE COST OPTIMAL POLICIES FOR MARKOV CONTROL PROCESSES WITH BOREL STATE-SPACE AND UNBOUNDED COSTS [J].
HERNANDEZLERMA, O ;
LASSERRE, JB .
SYSTEMS & CONTROL LETTERS, 1990, 15 (04) :349-356
[15]   WEAK CONDITIONS FOR AVERAGE OPTIMALITY IN MARKOV CONTROL PROCESSES [J].
HERNANDEZLERMA, O ;
LASSERRE, JB .
SYSTEMS & CONTROL LETTERS, 1994, 22 (04) :287-291
[16]  
PRAI PD, SOME CONNECTIONS STO
[19]   SOME COMMENTS ON A THEOREM OF HARDY AND LITTLEWOOD [J].
SZNAJDER, R ;
FILAR, JA .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1992, 75 (01) :201-208
[20]  
Whittle P, 1990, RISK SENSITIVE OPTIM