MARKOV DECISION CHAINS IN DISCRETE- AND CONTINUOUS-TIME; A UNIFIED APPROACH

被引：0
|
作者：
Sladky, Karel [1 ]
机构：
[1] Acad Sci Czech Republ, Inst Informat Theory & Automat, Dept Econometr, CR-18208 Prague 8, Czech Republic
来源：
QUANTITATIVE METHODS IN ECONOMICS [MULTIPLE CRITERIA DECISION MAKING XV] | 2010年
关键词：
discrete-time and continuous-time Markov decision chains; discounted and averaging optimality; connections between discounted and averaging models; uniformization; GAIN;
D O I：
暂无
中图分类号：
F [经济];
学科分类号：
02 ;
摘要：
In this note we consider Markov decision chains with finite state space in discrete- and continuous-time setting for discounting and averaging optimality criteria. Connections between discounted and averaging optimality along with uniformization methods are employed for producing bounds on optimal discounted and average rewards.
引用
收藏
页码：207 / 219
页数：13
相关论文
共 17 条
  • [1] On the Numerical Analysis of Inhomogeneous Continuous-Time Markov Chains
    Arns, M.
    Buchholz, P.
    Panchenko, A.
    INFORMS JOURNAL ON COMPUTING, 2010, 22 (03) : 416 - 432
  • [2] Approximate adaptive uniformization of continuous-time Markov chains
    Andreychenko, Alexander
    Sandmann, Werner
    Wolf, Verena
    APPLIED MATHEMATICAL MODELLING, 2018, 61 : 561 - 576
  • [3] On the total reward variance for continuous-time Markov reward chains
    Van Dijk, Nico M.
    Sladky, Karel
    JOURNAL OF APPLIED PROBABILITY, 2006, 43 (04) : 1044 - 1052
  • [4] Model-checking algorithms for continuous-time Markov chains
    Baier, C
    Haverkort, B
    Hermanns, H
    Katoen, JP
    IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2003, 29 (06) : 524 - 541
  • [5] SUMMARY STATISTICS FOR ENDPOINT-CONDITIONED CONTINUOUS-TIME MARKOV CHAINS
    Hobolth, Asger
    Jensen, Jens Ledet
    JOURNAL OF APPLIED PROBABILITY, 2011, 48 (04) : 911 - 924
  • [6] CONSERVATIVE PARALLEL SIMULATION OF CONTINUOUS-TIME MARKOV-CHAINS USING UNIFORMIZATION
    HEIDELBERGER, P
    NICOL, DM
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 1993, 4 (08) : 906 - 921
  • [7] Time-Bounded Model Checking of Infinite-State Continuous-Time Markov Chains
    Hahn, E. Moritz
    Hermanns, Holger
    Wachter, Bjoern
    Zhang, Lijun
    FUNDAMENTA INFORMATICAE, 2009, 95 (01) : 129 - 155
  • [8] SIMULATION FROM ENDPOINT-CONDITIONED, CONTINUOUS-TIME MARKOV CHAINS ON A FINITE STATE SPACE, WITH APPLICATIONS TO MOLECULAR EVOLUTION
    Hobolth, Asger
    Stone, Eric A.
    ANNALS OF APPLIED STATISTICS, 2009, 3 (03) : 1204 - 1231
  • [9] Bayesian Analysis of Continuous Time Markov Chains with Application to Phylogenetic Modelling
    Zhao, Tingting
    Wang, Ziyu
    Cumberworth, Alexander
    Gsponer, Joerg
    de Freitas, Nando
    Bouchard-Cote, Alexandre
    BAYESIAN ANALYSIS, 2016, 11 (04): : 1203 - 1237
  • [10] Analysis of Discrete-Time Integrating Amplifiers as an Alternative to Continuous-Time Amplifiers in Broadband Receivers
    Ray, Yudhajit
    Sen, Shreyas
    IEEE OPEN JOURNAL OF CIRCUITS AND SYSTEMS, 2023, 4 : 347 - 362
12