Perturbation analysis for continuous-time Markov chains

被引：0
作者：
LIU YuanYuan
机构：
[1] SchoolofMathematicsandStatistics,CentralSouthUniversity
来源：
Science China(Mathematics) | 2015年 / 58卷 / 12期
关键词：
Markov chains; stationary distribution; perturbation analysis; exponential ergodicity; deviation matrix;
D O I：
暂无
中图分类号：
O211.62 [马尔可夫过程];
学科分类号：
020208 ; 070103 ; 0714 ;
摘要：
We investigate perturbation for continuous-time Markov chains(CTMCs) on a countable state space. Explicit bounds on ?D and D are derived in terms of a drift condition, where ? and D represent the perturbation of the intensity matrices and the deviation matrix, respectively. Moreover, we obtain perturbation bounds on the stationary distributions, which extends the results by Liu(2012) for uniformly bounded CTMCs to general(possibly unbounded) CTMCs. Our arguments are mainly based on the technique of augmented truncations.
引用
收藏
页码：2633 / 2642
页数：10
相关论文
共 50 条
[31]   Full Perturbation Analysis of the LMI-Based Continuous-Time Linear Quadratic Regulator Problem [J].
Yonchev, Andrey ;
Konstantinov, Mihail ;
Petkov, Petko .
CYBERNETICS AND INFORMATION TECHNOLOGIES, 2011, 11 (01) :26-35
[32]   Constructing performance sensitivities with sample paths in continuous-time Markov systems [J].
Cao, Fang ;
Cao, Xi-Ren .
PROCEEDINGS OF THE 45TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-14, 2006, :1069-1074
[33]   STATIONARY AVERAGING FOR MULTISCALE CONTINUOUS TIME MARKOV CHAINS USING PARALLEL REPLICA DYNAMICS [J].
Wang, Ting ;
Plechac, Petr ;
Aristoff, David .
MULTISCALE MODELING & SIMULATION, 2018, 16 (01) :1-27
[34]   New perturbation bounds for denumerable Markov chains [J].
Mouhoubi, Zahir ;
Aissani, Djamil .
LINEAR ALGEBRA AND ITS APPLICATIONS, 2010, 432 (07) :1627-1649
[35]   Blockwise perturbation theory for 2 x 2 block Markov chains [J].
Xue, JG ;
Gao, WG .
JOURNAL OF COMPUTATIONAL MATHEMATICS, 2000, 18 (03) :305-312
[36]   SENSITIVITY OF FINITE MARKOV-CHAINS UNDER PERTURBATION [J].
SENETA, E .
STATISTICS & PROBABILITY LETTERS, 1993, 17 (02) :163-168
[37]   Perturbation theory for Markov chains via Wasserstein distance [J].
Rudolf, Daniel ;
Schweizer, Nikolaus .
BERNOULLI, 2018, 24 (4A) :2610-2639
[38]   Spectral representations of the transition probability matrices for continuous time finite Markov chains [J].
Peng, NF .
JOURNAL OF APPLIED PROBABILITY, 1996, 33 (01) :28-33
[39]   A sequential direct hybrid algorithm to compute stationary distribution of continuous-time Markov chain [J].
Brazenas, Mindaugas ;
Valakevicius, Eimutis .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 207
[40]   Continuous-time threshold AR(1) processes [J].
Stramer, O ;
Brockwell, PJ ;
Tweedie, RL .
ADVANCES IN APPLIED PROBABILITY, 1996, 28 (03) :728-746
12345