Ergodic risk-sensitive control-A survey

被引:8
作者
Biswas, Anup [1 ]
Borkar, Vivek S. [2 ]
机构
[1] Indian Inst Sci Educ & Res Pune, Dept Math, Dr Homi Bhabha Rd, Pune 411008, India
[2] Indian Inst Technol, Dept Elect Engn, Mumbai 400076, India
关键词
Risk-sensitive control; Bellman equation; Generalized principal eigenvalue; Multiplicative dynamic programming; Verification theorem; Markov decision process; MARKOV DECISION-PROCESSES; INFINITE-HORIZON RISK; 2ND-ORDER ELLIPTIC-OPERATORS; VANISHING DISCOUNT APPROACH; FINITE-STATE MACHINES; AVERAGE COST; DISCRETE-TIME; BELLMAN EQUATIONS; PRINCIPAL EIGENVALUE; VARIATIONAL FORMULA;
D O I
10.1016/j.arcontrol.2023.03.001
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Risk-sensitive control has received considerable interest since the seminal work of Howard and Matheson (Howard and Matheson, 1971/72) because of its ability to account for fluctuations about the mean, its connection with ������& INFIN; control, and its application to financial mathematics. In this article we attempt to put together a comprehensive survey on the research done on ergodic risk-sensitive control over the last four decades.
引用
收藏
页码:118 / 141
页数:24
相关论文
共 157 条
[1]   Learning algorithms or Markov decision processes with average cost [J].
Abounadi, J ;
Bertsekas, D ;
Borkar, VS .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2001, 40 (03) :681-698
[2]   FINITE-DIMENSIONAL QUASI-LINEAR RISK-SENSITIVE CONTROL [J].
AGGOUN, L ;
BENSOUSSAN, A ;
ELLIOTT, RJ ;
MOORE, JB .
SYSTEMS & CONTROL LETTERS, 1995, 25 (02) :151-157
[3]  
Agmon S, 1983, METHODS FUNCTIONAL A, P19
[4]  
Alanís-Durán A, 2012, KYBERNETIKA, V48, P83
[5]   A VARIATIONAL FORMULA FOR RISK-SENSITIVE REWARD [J].
Anantharam, V. ;
Borkar, V. S. .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2017, 55 (02) :961-988
[6]   DISCRETE-TIME CONTROLLED MARKOV-PROCESSES WITH AVERAGE COST CRITERION - A SURVEY [J].
ARAPOSTATHIS, A ;
BORKAR, VS ;
FERNANDEZGAUCHERAND, E ;
GHOSH, MK ;
MARCUS, SI .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1993, 31 (02) :282-344
[7]  
Arapostathis A., 2012, Ergodic control of diffusion processes, V143
[8]  
Arapostathis A., 2022, J DIFFER EQUATIONS
[9]   RISK-SENSITIVE CONTROL FOR A CLASS OF DIFFUSIONS WITH JUMPS [J].
Arapostathis, Ari ;
Biswas, Anup .
ANNALS OF APPLIED PROBABILITY, 2022, 32 (06) :4106-4142
[10]   Linear and Dynamic Programs for Risk-Sensitive Cost Minimization [J].
Arapostathis, Ari ;
Borkar, Vivek S. .
2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, :3042-3047