Criteria for Geometric and Algebraic Transience for Discrete-Time Markov Chains

被引:1
|
作者
Mao, Yong-Hua [1 ]
Song, Yan-Hong [2 ]
机构
[1] Beijing Normal Univ, Sch Math Sci, Lab Math & Complex Syst, Minist Educ, Beijing 100875, Peoples R China
[2] Zhongnan Univ Econ & Law, Sch Stat & Math, Wuhan 430073, Peoples R China
基金
中国国家自然科学基金;
关键词
Markov chain; Geometric transience; Algebraic transience; First return time; Last exit time; Drift condition; SUBGEOMETRIC RATES; CONVERGENCE; ERGODICITY; PROPERTY;
D O I
10.1007/s10959-021-01105-5
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We present new criteria for geometric and algebraic transience for discrete-time transient Markov chains on general state spaces, based on the moment of the last exit time, the modified moment of the first return time and the drift condition for the transition kernel. These criteria turn out to be more convenient to use, supplementing and extending conditions introduced by Mao and Song [Stochastic Process. Appl. 124 (2014) 1648-1678]. Several applications are presented including discrete queueing Markov chains, Galton-Watson branching processes, downwardly skip-free chains, unrestricted random walks and autoregressive models of order one.
引用
收藏
页码:1974 / 2008
页数:35
相关论文
共 50 条
  • [31] Exponential bounds for discrete-time singularly perturbed Markov chains
    Zhang, Q
    Yin, G
    JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2004, 293 (02) : 645 - 662
  • [32] ON THE CRITERIA OF TRANSIENCE AND RECURRENCE FOR THE DISCRETE-TIME BIRTH-DEATH CHAINS DEFINED BY DIRECTED WEIGHTED CIRCUITS IN RANDOM ERGODIC ENVIRONMENTS
    Ganatsiou, Chrysoula
    JP Journal of Biostatistics, 2016, 13 (02) : 103 - 117
  • [33] Discrete-time Markov chains: Two-time-scale methods and applications
    Schrijner, PC
    JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 2006, 57 (03) : 326 - 327
  • [34] On Transience Conditions for Markov Chains
    S. G. Foss
    D. È. Denisov
    Siberian Mathematical Journal, 2001, 42 : 364 - 371
  • [35] Variational formulas for asymptotic variance of general discrete-time Markov chains
    Huang, Lu-Jing
    Mao, Yong-Hua
    BERNOULLI, 2023, 29 (01) : 300 - 322
  • [36] Discrete-Time Markov Chains for Modeling Affective Lability in Bipolar Disorder
    Yee, Michael
    Yocum, Anastasia
    Han, Peisong
    McInnis, Melvin
    BIOLOGICAL PSYCHIATRY, 2020, 87 (09) : S274 - S274
  • [37] Formalization of Finite-State Discrete-Time Markov Chains in HOL
    Liu, Liya
    Hasan, Osman
    Tahar, Sofiene
    AUTOMATED TECHNOLOGY FOR VERIFICATION AND ANALYSIS, 2011, 6996 : 90 - 104
  • [38] Discrete-Time Markov Chains in Reliability Analysis-Case Study
    Skalny, Pavel
    Krajc, Bohumil
    INTERNATIONAL JOINT CONFERENCE CISIS'12 - ICEUTE'12 - SOCO'12 SPECIAL SESSIONS, 2013, 189 : 421 - 427
  • [39] Hilbert evolution algebras and its connection with discrete-time Markov chains
    Vidal, Sebastian J.
    Cadavid, Paula
    Rodriguez, Pablo M.
    INDIAN JOURNAL OF PURE & APPLIED MATHEMATICS, 2023, 54 (03): : 883 - 894
  • [40] New exactly solvable examples for controlled discrete-time Markov chains
    Piunovskii, A.B.
    Khametov, V.M.
    Cybernetics (English Translation of Kibernetika), 1992, 27 (03):