The deviation matrix of a continuous-time Markov chain

被引:58
作者
Coolen-Schrijner, P [1 ]
van Doorn, EA
机构
[1] Univ Durham, Dept Math Sci, Durham, England
[2] Univ Twente, Fac Math Sci, Enschede, Netherlands
关键词
D O I
10.1017/S0269964802163066
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The deviation matrix of an ergodic, continuous-time Markov chain with transition probability matrix P(.) and ergodic matrix Pi is the matrix Dequivalent tof(o)(infinity)(P(t)-Pi) dt. We give conditions for D to exist and discuss properties and a representation of D. The deviation matrix of a birth-death process is investigated in detail. We also describe a new application of deviation matrices by showing that a measure for the convergence to stationarity of a stochastically increasing Markov chain can be expressed in terms of the elements of the deviation matrix of the chain.
引用
收藏
页码:351 / 366
页数:16
相关论文
共 25 条
[1]  
Anderson W. J., 1991, CONTINUOUS TIME MARK
[2]  
[Anonymous], 1964, THEORIE ANWENDUNG UN
[3]   On the convergence to stationarity of birth-death processes [J].
Coolen-Schrijner, P ;
Van Doorn, EA .
JOURNAL OF APPLIED PROBABILITY, 2001, 38 (03) :696-706
[4]   AVERAGE, SENSITIVE AND BLACKWELL OPTIMAL POLICIES IN DENUMERABLE MARKOV DECISION CHAINS WITH UNBOUNDED REWARDS [J].
DEKKER, R ;
HORDIJK, A .
MATHEMATICS OF OPERATIONS RESEARCH, 1988, 13 (03) :395-420
[6]   Overcoming instability in computing the fundamental matrix for a Markov chain [J].
Heyman, DP ;
O'Leary, DP .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 1998, 19 (02) :534-540
[7]  
Heyman DP, 1995, COMPUTATIONS WITH MARKOV CHAINS, P151
[8]  
Hordijk A, 1994, PROBABILITY STAT OPT, P497
[10]  
Iosifescu M., 1980, Finite markov processes and their applications