Censoring, factorizations, and spectral analysis for transition matrices with block-repeating entries

被引:27
作者
Zhao, YQQ [1 ]
Li, W
Braun, WJ
机构
[1] Carleton Univ, Sch Math & Stat, Ottawa, ON K1S 5B6, Canada
[2] Univ Toledo, Dept Elect Engn & Comp Sci, Toledo, OH 43606 USA
[3] Univ Western Ontario, Dept Stat & Actuarial Sci, London, ON N6A 5B7, Canada
关键词
block-Toeplitz transition matrices; factorization of characteristic functions; spectral analysis; fundamental matrix; conditions of recurrence and transience;
D O I
10.1023/A:1024125320911
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this paper, we use the Markov chain censoring technique to study infinite state Markov chains whose transition matrices possess block-repeating entries. We demonstrate that a number of important probabilistic measures are invariant under censoring. Informally speaking, these measures involve first passage times or expected numbers of visits to certain levels where other levels are taboo; they are closely related to the so-called fundamental matrix of the Markov chain which is also studied here. Factorization theorems for the characteristic equation of the blocks of the transition matrix are obtained. Necessary and sufficient conditions are derived for such a Markov chain to be positive recurrent, null recurrent, or transient based either on spectral analysis, or on a property of the fundamental matrix. Explicit expressions are obtained for key probabilistic measures. including the stationary probability vector and the fundamental matrix, which could be potentially used to develop various recursive algorithms for computing these measures.
引用
收藏
页码:35 / 58
页数:24
相关论文
共 19 条
[1]  
Asmussen S, 2008, APPL PROBABILITY QUE, V51
[2]  
DUKHOVNY A, 1990, J APPL MATH STOCHAST, V3, P141
[3]  
DUKHOVNY A, 1989, J APPL MATH SIMULATI, V2, P205
[4]   Spectral analysis of M/G/1 AND G/M/1 type MARKOV chains [J].
Gail, HR ;
Hantler, SL ;
Taylor, BA .
ADVANCES IN APPLIED PROBABILITY, 1996, 28 (01) :114-165
[5]   Non-skip-free M/G/1 and G/M/1 type Markov chains [J].
Gail, HR ;
Hantler, SL ;
Taylor, BA .
ADVANCES IN APPLIED PROBABILITY, 1997, 29 (03) :733-758
[6]  
Grassmann W. K., 1993, ORSA Journal on Computing, V5, P292, DOI 10.1287/ijoc.5.3.292
[7]  
GRASSMANN WK, 1985, J OPER RES SOC, V36, P1041
[8]   EQUILIBRIUM DISTRIBUTION OF BLOCK-STRUCTURED MARKOV-CHAINS WITH REPEATING ROWS [J].
GRASSMANN, WK ;
HEYMAN, DP .
JOURNAL OF APPLIED PROBABILITY, 1990, 27 (03) :557-576
[9]  
Kemeny J. G., 1976, DENUMERABLE MARKOV C
[10]  
Latouche Guy, 1999, Introduction to Matrix Analytic Methods in Stochastic Modeling, V5, DOI DOI 10.1137/1.9780898719734