UNIFORMIZATION FOR NONHOMOGENEOUS MARKOV-CHAINS

被引:16
|
作者
VANDIJK, NM
机构
[1] University of Amsterdam, Amsterdam
关键词
CONTINUOUS-TIME MARKOV CHAINS; UNIFORMIZATION; TIME-DISCRETIZATION;
D O I
10.1016/0167-6377(92)90086-I
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
The discrete Poissonian representation for transition probabilities of homogeneous continuous-time Markov chains, known as uniformization or randomization, is extended to time-inhomogeneous chains. For computational purposes a discrete-time approximation is also provided.
引用
收藏
页码:283 / 291
页数:9
相关论文
共 50 条
  • [41] SUMMARY STATISTICS FOR ENDPOINT-CONDITIONED CONTINUOUS-TIME MARKOV CHAINS
    Hobolth, Asger
    Jensen, Jens Ledet
    JOURNAL OF APPLIED PROBABILITY, 2011, 48 (04) : 911 - 924
  • [42] On-the-fly verification and optimization of DTA-properties for large Markov chains
    Linar Mikeev
    Martin R. Neuhäußer
    David Spieler
    Verena Wolf
    Formal Methods in System Design, 2013, 43 : 313 - 337
  • [43] Verification of Linear Duration Properties over Continuous-Time Markov Chains
    Chen, Taolue
    Diciolla, Marco
    Kwiatkowska, Marta
    Mereacre, Alexandru
    ACM TRANSACTIONS ON COMPUTATIONAL LOGIC, 2013, 14 (04)
  • [44] SIMULATION FROM ENDPOINT-CONDITIONED, CONTINUOUS-TIME MARKOV CHAINS ON A FINITE STATE SPACE, WITH APPLICATIONS TO MOLECULAR EVOLUTION
    Hobolth, Asger
    Stone, Eric A.
    ANNALS OF APPLIED STATISTICS, 2009, 3 (03) : 1204 - 1231
  • [45] MODEL CHECKING OF CONTINUOUS-TIME MARKOV CHAINS AGAINST TIMED AUTOMATA SPECIFICATIONS
    Chen, Taolue
    Han, Tingting
    Katoen, Joost-Pieter
    Mereacre, Alexandru
    LOGICAL METHODS IN COMPUTER SCIENCE, 2011, 7 (01)
  • [46] Numerical Method for Reliability Analysis of Phased-Mission System Using Markov Chains
    Wu, Xiaoyue
    Yan, Hua
    Li, Lirong
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2012, 41 (21) : 3960 - 3973
  • [47] On obtaining sharp bounds of the rate of convergence for a class of continuous-time Markov chains
    Zeifman, A., I
    Satin, Y. A.
    Kiseleva, K. M.
    STATISTICS & PROBABILITY LETTERS, 2020, 161
  • [48] Hoeffding's Inequality for Continuous-time Markov Chains Via the Spectral Gap
    Liu, Jinpeng
    Liu, Yuanyuan
    Zhou, Lin
    POTENTIAL ANALYSIS, 2025,
  • [49] Queuing and Service Management for Congestion Control in Wireless Sensor Networks Using Markov Chains
    Hafidi, Samy
    Gharbi, Nawel
    Mokdad, Lynda
    2017 IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS (ISCC), 2017, : 176 - 181
  • [50] OPTIMAL CONTROL OF CONTINUOUS-TIME MARKOV CHAINS WITH NOISE-FREE OBSERVATION
    Calvia, A.
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2018, 56 (03) : 2000 - 2035