Risk-sensitive control of discrete-time Markov processes with infinite horizon

被引：112

作者：

Di Masi, GB

Stettner, L

机构：

[1] Univ Padua, Dipartimento Matemat Pura & Applicata, I-35131 Padua, Italy

[2] Polish Acad Sci, Inst Math, PL-00950 Warsaw, Poland

来源：

SIAM JOURNAL ON CONTROL AND OPTIMIZATION | 1999年 / 38卷 / 01期

关键词：

controlled discrete-time Markov processes; exponential ergodic performance criterion; Bellman equation;

D O I：

10.1137/S0363012997320614

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

In this paper we study existence of solutions to the Bellman equation corresponding to risk-sensitive ergodic control of discrete-time Markov processes using three different approaches. Also, for particular classes of systems, asymptotics for vanishing risk factor is investigated, showing that in the limit the optimal value for an average cost per unit time is obtained.

引用

页码：61 / 78

页数：18

共 15 条

[1] Cavazos-Cadena R, 1999, MATH METHOD OPER RES, V49, P299
[2] DISCOUNTED MDP - DISTRIBUTION-FUNCTIONS AND EXPONENTIAL UTILITY MAXIMIZATION
CHUNG, KJ
SOBEL, MJ
[J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1987, 25 (01) : 49 - 62
[3] ASYMPTOTIC EVALUATION OF CERTAIN MARKOV PROCESS EXPECTATIONS FOR LARGE TIME, I
DONSKER, MD
VARADHAN, SRS
[J]. COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 1975, 28 (01) : 1 - 47
[4] ASYMPTOTIC EVALUATION OF CERTAIN MARKOV PROCESS EXPECTATIONS FOR LARGE TIME .3.
DONSKER, MD
VARADHAN, SRS
[J]. COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 1976, 29 (04) : 389 - 461
[5] RISK-SENSITIVE CONTROL ON AN INFINITE TIME HORIZON
FLEMING, WH
MCENEANEY, WM
[J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1995, 33 (06) : 1881 - 1915
[6] Risk-sensitive control of finite state machines on an infinite horizon .1.
Fleming, WH
HernandezHernanadez, D
[J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1997, 35 (05) : 1790 - 1810
[7] STATE-SPACE FORMULAS FOR ALL STABILIZING CONTROLLERS THAT SATISFY AN H INFINITY-NORM BOUND AND RELATIONS TO RISK SENSITIVITY
GLOVER, K
DOYLE, JC
[J]. SYSTEMS & CONTROL LETTERS, 1988, 11 (03) : 167 - 172
[8] Risk sensitive control of Markov processes in countable state space
HernandezHernandez, D
Marcus, SI
[J]. SYSTEMS & CONTROL LETTERS, 1996, 29 (03) : 147 - 155
[9] HERNANDEZLERMA O, 1989, ADAPTIVE CONTROL PRO
[10] Bellman equations of risk-sensitive control
Nagai, H
[J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1996, 34 (01) : 74 - 101

← 1 2 →