On "sluggish transients" in Markov chains

被引:1
作者
O'Cinneide, C [1 ]
机构
[1] Purdue Univ, Sch Ind Engn, W Lafayette, IN 47907 USA
关键词
Markov chain; rate of convergence; Jordan block;
D O I
10.1137/S0895479899355359
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The distance between the powers P-m of an aperiodic stochastic matrix and their limit behaves roughlylike rho(m) as m --> infinity, where rho is the maximum modulus of the eigenvalues whose moduli are less than 1. G. W. Stewart noted ( see [ Stochastic Models, 31 ( 1997), pp. 85 94]) that when there are defective eigenvalues that are close to 1 in modulus, the powers of P may initially display slower convergence than might be expected based on the magnitudes of the eigenvalues alone. Stewart introduced a quantity sigma that has a bearing on the strength of this effect. Numerical experimentation led him to suggest that sigma cannot be too large. We derive upper bounds on which help to explain Stewart s empirical observations.
引用
收藏
页码:320 / 333
页数:14
相关论文
共 25 条
  • [11] Greub W. H., 2012, Linear Algebra
  • [12] ON STOCHASTIC-PROCESSES DERIVED FROM MARKOV-CHAINS
    HELLER, A
    [J]. ANNALS OF MATHEMATICAL STATISTICS, 1965, 36 (04): : 1286 - 1291
  • [13] JONSSON GJ, 1998, NUMERICAL ANAL 1997
  • [14] CHARACTERIZATION OF STRUCTURE-GENERATING FUNCTIONS OF REGULAR SETS AND DOL GROWTH FUNCTIONS
    KATAYAMA, T
    OKAMOTO, M
    ENOMOTO, H
    [J]. INFORMATION AND CONTROL, 1978, 36 (01): : 85 - 101
  • [15] KINGMAN JFC, 1973, STOCHASTIC ANAL TRIB, P180
  • [16] RANDOM-WALKS IN A CONVEX BODY AND AN IMPROVED VOLUME ALGORITHM
    LOVASZ, L
    SIMONOVITS, M
    [J]. RANDOM STRUCTURES & ALGORITHMS, 1993, 4 (04) : 359 - 412
  • [17] Maier R S., 1991, Commun. Stat., V7, P573
  • [18] MOTWANI R, 1985, RANDOMIZED ALGORITHM
  • [19] O'Cinneide C.A., 1990, COMM STAT STOCHASTIC, V6, P1
  • [20] O'Cinneide C.A., 1999, COMMUN STATIST STOCH, V15, P731, DOI DOI 10.1080/15326349908807560