Process-based risk measures and risk-averse control of discrete-time systems

被引:10
作者
Fan, Jingnan [1 ]
Ruszczynski, Andrzej [2 ]
机构
[1] Rutgers State Univ, RUTCOR, Piscataway, NJ 08854 USA
[2] Rutgers State Univ, Dept Management Sci & Informat Syst, Piscataway, NJ 08854 USA
关键词
Dynamic risk measures; Time consistency; Dynamic programming; Multistage stochastic programming; MARKOV DECISION-PROCESSES; STOCHASTIC PROGRAMS; SENSITIVE CONTROL; VARIANCE; DOMINANCE; UTILITY; CONSISTENCY; CRITERION; POLICIES; THEOREM;
D O I
10.1007/s10107-018-1349-2
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
For controlled discrete-time stochastic processes we introduce a new class of dynamic risk measures, which we call process-based. Their main feature is that they measure risk of processes that are functions of the history of a base process. We introduce a new concept of conditional stochastic time consistency and we derive the structure of process-based risk measures enjoying this property. We show that they can be equivalently represented by a collection of static law-invariant risk measures on the space of functions of the state of the base process. We apply this result to controlled Markov processes and we derive dynamic programming equations. We also derive dynamic programming equations for multistage stochastic programming with decision-dependent distributions.
引用
收藏
页码:113 / 140
页数:28
相关论文
共 57 条
[1]   Markov Decision Problems Where Means Bound Variances [J].
Arlotto, Alessandro ;
Gans, Noah ;
Steele, J. Michael .
OPERATIONS RESEARCH, 2014, 62 (04) :864-875
[2]   STABILITY RESULTS FOR STOCHASTIC PROGRAMS AND SENSORS, ALLOWING FOR DISCONTINUOUS OBJECTIVE FUNCTIONS [J].
ARTSTEIN, Z ;
WETS, RJB .
SIAM JOURNAL ON OPTIMIZATION, 1994, 4 (03) :537-550
[3]   Coherent multiperiod risk adjusted values and Bellman's principle [J].
Artzner, Philippe ;
Delbaen, Freddy ;
Eber, Jean-Marc ;
Heath, David ;
Ku, Hyejin .
ANNALS OF OPERATIONS RESEARCH, 2007, 152 (1) :5-22
[4]  
Aubin J-P., 2009, SET-VALUED ANAL
[5]   More Risk-Sensitive Markov Decision Processes [J].
Baeuerle, Nicole ;
Rieder, Ulrich .
MATHEMATICS OF OPERATIONS RESEARCH, 2014, 39 (01) :105-120
[6]   Risk sensitive control of finite state Markov chains in discrete time, with applications to portfolio management [J].
Bielecki, T ;
Hernández-Hernández, D ;
Pliska, SR .
MATHEMATICAL METHODS OF OPERATIONS RESEARCH, 1999, 50 (02) :167-188
[7]  
Billingsley P., 2013, CONVERGE PROBAB MEAS
[8]   RISK-AVERSE CONTROL OF UNDISCOUNTED TRANSIENT MARKOV MODELS [J].
Cavus, Ozlem ;
Ruszczynski, Andrzej .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2014, 52 (06) :3935-3966
[9]   Computational Methods for Risk-Averse Undiscounted Transient Markov Models [J].
Cavus, Ozlem ;
Ruszczynski, Andrzej .
OPERATIONS RESEARCH, 2014, 62 (02) :401-417
[10]   Time-consistent investment policies in Markovian markets: A case of mean-variance analysis [J].
Chen, Zhiping ;
Li, Gang ;
Zhao, Yonggan .
JOURNAL OF ECONOMIC DYNAMICS & CONTROL, 2014, 40 :293-316