UNIFORMIZATION FOR NONHOMOGENEOUS MARKOV-CHAINS

被引：16
|
作者：
VANDIJK, NM
机构：
[1] University of Amsterdam, Amsterdam
来源：
OPERATIONS RESEARCH LETTERS | 1992年 / 12卷 / 05期
关键词：
CONTINUOUS-TIME MARKOV CHAINS; UNIFORMIZATION; TIME-DISCRETIZATION;
D O I：
10.1016/0167-6377(92)90086-I
中图分类号：
C93 [管理学]; O22 [运筹学];
学科分类号：
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要：
The discrete Poissonian representation for transition probabilities of homogeneous continuous-time Markov chains, known as uniformization or randomization, is extended to time-inhomogeneous chains. For computational purposes a discrete-time approximation is also provided.
引用
收藏
页码：283 / 291
页数：9
相关论文
共 50 条
  • [21] On the Numerical Analysis of Inhomogeneous Continuous-Time Markov Chains
    Arns, M.
    Buchholz, P.
    Panchenko, A.
    INFORMS JOURNAL ON COMPUTING, 2010, 22 (03) : 416 - 432
  • [22] Analysis of signalling pathways using continuous time Markov chains
    Calder, Muffy
    Vyshemirsky, Vladislav
    Gilbert, David
    Orton, Richard
    TRANSACTIONS ON COMPUTATIONAL SYSTEMS BIOLOGY VI, 2006, 4220 : 44 - +
  • [23] Control of continuous-time Markov chains with safety constraints
    Hsu, Shun-Pin
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2012, 22 (05) : 492 - 503
  • [24] Controllability and decentralized stabilization of the Kolmogorov forward equation for Markov chains
    Elamvazhuthi, Karthik
    Biswal, Shiba
    Berman, Spring
    AUTOMATICA, 2021, 124
  • [25] Transient Reward Approximation for Continuous-Time Markov Chains
    Hahn, Ernst Moritz
    Hermanns, Holger
    Wimmer, Ralf
    Becker, Bernd
    IEEE TRANSACTIONS ON RELIABILITY, 2015, 64 (04) : 1254 - 1275
  • [26] An MM Algorithm to Estimate Parameters in Continuous-Time Markov Chains
    Bacci, Giovanni
    Ingolfsdottir, Anna
    Larsen, Kim G.
    Reynouard, Raphael
    QUANTITATIVE EVALUATION OF SYSTEMS, QEST 2023, 2023, 14287 : 82 - 100
  • [27] On the total reward variance for continuous-time Markov reward chains
    Van Dijk, Nico M.
    Sladky, Karel
    JOURNAL OF APPLIED PROBABILITY, 2006, 43 (04) : 1044 - 1052
  • [28] A Stochastic Assessment of Attacks based on Continuous-Time Markov Chains
    Sadu, Abhinav
    Stevic, Marija
    Wirtz, Nikolaus
    Monti, Antonello
    2020 6TH IEEE INTERNATIONAL ENERGY CONFERENCE (ENERGYCON), 2020, : 11 - 16
  • [29] Model-checking algorithms for continuous-time Markov chains
    Baier, C
    Haverkort, B
    Hermanns, H
    Katoen, JP
    IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2003, 29 (06) : 524 - 541
  • [30] Bayesian Analysis of Continuous Time Markov Chains with Application to Phylogenetic Modelling
    Zhao, Tingting
    Wang, Ziyu
    Cumberworth, Alexander
    Gsponer, Joerg
    de Freitas, Nando
    Bouchard-Cote, Alexandre
    BAYESIAN ANALYSIS, 2016, 11 (04): : 1203 - 1237
12345