Risk measurement and risk-averse control of partially observable discrete-time Markov systems

被引:10
|
作者
Fan, Jingnan [1 ]
Ruszczynski, Andrzej [2 ]
机构
[1] Rutgers State Univ, RUTCOR, Piscataway, NJ 08854 USA
[2] Rutgers State Univ, Dept Management Sci & Informat Syst, Piscataway, NJ 08854 USA
基金
美国国家科学基金会;
关键词
Partially observable Markov processes; Dynamic risk measures; Time consistency; Dynamic programming; DECISION-PROCESSES; STOCHASTIC-DOMINANCE; SENSITIVE CONTROL; VARIANCE; OPTIMIZATION;
D O I
10.1007/s00186-018-0633-5
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We consider risk measurement in controlled partially observable Markov processes in discrete time. We introduce a new concept of conditional stochastic time consistency and we derive the structure of risk measures enjoying this property. We prove that they can be represented by a collection of static law invariant risk measures on the space of function of the observable part of the state. We also derive the corresponding dynamic programming equations. Finally we illustrate the results on a machine deterioration problem.
引用
收藏
页码:161 / 184
页数:24
相关论文
共 50 条
  • [31] The optimal probability of the risk for finite horizon partially observable Markov decision processes
    Wen, Xian
    Huo, Haifeng
    Cui, Jinhua
    AIMS MATHEMATICS, 2023, 8 (12): : 28435 - 28449
  • [32] Time-consistent approximations of risk-averse multistage stochastic optimization problems
    Asamov, Tsvetan
    Ruszczynski, Andrzej
    MATHEMATICAL PROGRAMMING, 2015, 153 (02) : 459 - 493
  • [33] A set evolution approach to the control of uncertain systems with discrete-time measurement
    Rigal, Sylvain
    JOURNAL OF CONVEX ANALYSIS, 2006, 13 (02) : 443 - 461
  • [34] Risk-averse optimization for resilience enhancement of complex engineering systems under uncertainties
    Wu, Jiaxin
    Wang, Pingfeng
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2021, 215
  • [35] Risk-averse stochastic optimal control: An efficiently computable statistical upper bound
    Guigues, Vincent
    Shapiro, Alexander
    Cheng, Yi
    OPERATIONS RESEARCH LETTERS, 2023, 51 (04) : 393 - 400
  • [36] Novel Time-Varying Risk-Averse and Risk-Seeker Frameworks for Uncertain Wind Energy Generation in Electric Power Systems
    Eslahi, Milad
    Vahidi, Behrooz
    Siano, Pierluigi
    IEEE ACCESS, 2024, 12 : 179039 - 179049
  • [37] Static Output Constrained Control for Discrete-Time Hidden Markov Jump Linear Systems
    Zabala, Yeison A.
    Costa, Oswaldo L., V
    IEEE ACCESS, 2020, 8 : 62969 - 62979
  • [38] Discrete-time hybrid control with risk-sensitive discounted costs
    Blancas-Rivera, Ruben
    Jasso-Fuentes, Hector
    DISCRETE EVENT DYNAMIC SYSTEMS-THEORY AND APPLICATIONS, 2024, 34 (04): : 659 - 687
  • [39] Risk-Averse Stochastic Programming for Planning Hybrid Electrical Energy Systems: A Brazilian Case
    Kitamura, Daniel
    Willer, Leonardo
    Dias, Bruno
    Soares, Tiago
    ENERGIES, 2023, 16 (03)
  • [40] DISCRETE-TIME MARKOV CONTROL PROCESSES WITH RECURSIVE DISCOUNT RATES
    Garcia, Yofre H.
    Gonzalez-Hernandez, Juan
    KYBERNETIKA, 2016, 52 (03) : 403 - 426