Risk measurement and risk-averse control of partially observable discrete-time Markov systems

被引:10
|
作者
Fan, Jingnan [1 ]
Ruszczynski, Andrzej [2 ]
机构
[1] Rutgers State Univ, RUTCOR, Piscataway, NJ 08854 USA
[2] Rutgers State Univ, Dept Management Sci & Informat Syst, Piscataway, NJ 08854 USA
基金
美国国家科学基金会;
关键词
Partially observable Markov processes; Dynamic risk measures; Time consistency; Dynamic programming; DECISION-PROCESSES; STOCHASTIC-DOMINANCE; SENSITIVE CONTROL; VARIANCE; OPTIMIZATION;
D O I
10.1007/s00186-018-0633-5
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We consider risk measurement in controlled partially observable Markov processes in discrete time. We introduce a new concept of conditional stochastic time consistency and we derive the structure of risk measures enjoying this property. We prove that they can be represented by a collection of static law invariant risk measures on the space of function of the observable part of the state. We also derive the corresponding dynamic programming equations. Finally we illustrate the results on a machine deterioration problem.
引用
收藏
页码:161 / 184
页数:24
相关论文
共 50 条
  • [41] Risk-Averse Optimal Control Model Under Uncertainty and Its Modified Progressive Hedging Algorithm
    Sun, Jie
    Wu, Di
    Yu, Changjun
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2024, 203 (01) : 960 - 984
  • [42] Local Poisson Equations Associated with Discrete-Time Markov Control Processes
    Daniel Hernández Hernández
    Diego Hernández Bustos
    Journal of Optimization Theory and Applications, 2017, 173 : 1 - 29
  • [43] Local Poisson Equations Associated with Discrete-Time Markov Control Processes
    Hernandez Hernandez, Daniel
    Hernandez Bustos, Diego
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2017, 173 (01) : 1 - 29
  • [44] DETERMINISTIC AND STOCHASTIC CONTROL OF DISCRETE-TIME BILINEAR SYSTEMS
    SWAMY, KN
    TARN, TJ
    AUTOMATICA, 1979, 15 (06) : 677 - 682
  • [45] H∞ control for discrete-time nonlinear switching systems
    Zhang, Huan
    Huang, Shoudong
    James, Matthew R.
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2008, 18 (15) : 1451 - 1481
  • [46] Risk-averse two-stage stochastic programming for the inventory rebalancing of bike-sharing systems
    Walker, Awnalisa
    Kwon, Soongeol
    INTERNATIONAL TRANSACTIONS IN OPERATIONAL RESEARCH, 2024, 31 (02) : 749 - 779
  • [47] Optimal control of discrete-time switched linear systems
    Zhao, Jingang
    Gan, Minggang
    Chen, Guoliang
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2020, 357 (09): : 5340 - 5358
  • [48] Optimal control of discrete-time approximations to systems with hysteresis
    Belbas, SA
    Mayergoyz, ID
    PROCEEDINGS OF THE EIGHTH INTERNATIONAL COLLOQUIUM ON DIFFERENTIAL EQUATIONS, 1998, : 457 - 459
  • [49] Congestion Risk-Averse Stochastic Unit Commitment with Transmission Reserves in Wind-Thermal Power Systems
    Huang, Yu
    Xu, Qingshan
    Lin, Guang
    APPLIED SCIENCES-BASEL, 2018, 8 (10): : 1726
  • [50] Optimal Bidding for Risk-Averse Hybrid Power Station Producers in Insular Power Systems: An MPEC Approach
    Ntomaris, Andreas V.
    Bakirtzis, Anastasios G.
    2017 IEEE PES INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE EUROPE (ISGT-EUROPE), 2017,