Perturbation analysis for continuous-time Markov chains

被引：0

作者：

LIU YuanYuan ^{[1
]}

机构：

[1] School of Mathematics and Statistics, Central South University

来源：

ScienceChina(Mathematics) | 2015年 / 58卷 / 12期

基金：

中国国家自然科学基金; 中央高校基本科研业务费专项资金资助;

关键词：

Markov chains; stationary distribution; perturbation analysis; exponential ergodicity; deviation matrix;

D O I：

暂无

中图分类号：

O211.62 [马尔可夫过程];

学科分类号：

020208 ; 070103 ; 0714 ;

摘要：

We investigate perturbation for continuous-time Markov chains(CTMCs) on a countable state space. Explicit bounds on ?D and D are derived in terms of a drift condition, where ? and D represent the perturbation of the intensity matrices and the deviation matrix, respectively. Moreover, we obtain perturbation bounds on the stationary distributions, which extends the results by Liu(2012) for uniformly bounded CTMCs to general(possibly unbounded) CTMCs. Our arguments are mainly based on the technique of augmented truncations.

引用

页码：2633 / 2642

页数：10

共 50 条

[11] Contraction Integrated Semigroups and Their Application to Continuous-time Markov Chains [J].

Yang Rong Li .

Acta Mathematica Sinica, 2003, 19 :605-618

[12] A unified perturbation analysis framework for countable Markov chains [J].

Jiang, Shuxia ;

Liu, Yuanyuan ;

Tang, Yingchun .

LINEAR ALGEBRA AND ITS APPLICATIONS, 2017, 529 :413-440

[13] When Markov chains meet: A continuous-time model of network evolution [J].

Gilboa-Freedman, Gail ;

Hassin, Refael .

STATISTICS & PROBABILITY LETTERS, 2016, 116 :131-138

[14] Fitting timeseries by continuous-time Markov chains: A quadratic programming approach [J].

Crommelin, D. T. ;

Vanden-Eijnden, E. .

JOURNAL OF COMPUTATIONAL PHYSICS, 2006, 217 (02) :782-805

[15] Time-Bounded Model Checking of Infinite-State Continuous-Time Markov Chains [J].

Hahn, E. Moritz ;

Hermanns, Holger ;

Wachter, Bjoern ;

Zhang, Lijun .

FUNDAMENTA INFORMATICAE, 2009, 95 (01) :129-155

[16] Continuous-time block-monotone Markov chains and their block-augmented truncations [J].

Masuyama, Hiroyuki .

LINEAR ALGEBRA AND ITS APPLICATIONS, 2017, 514 :105-150

[17] Calibrating Linear Continuous-Time Dynamical Systems via Perturbation Analysis [J].

Weng, Peter Chang-Yi ;

Phoa, Frederick Kin Hing .

FILOMAT, 2018, 32 (05) :1909-1915

[18] SMOOTHED PERTURBATION ANALYSIS DERIVATIVE ESTIMATION FOR MARKOV-CHAINS [J].

FU, MC ;

HU, JQ .

OPERATIONS RESEARCH LETTERS, 1994, 15 (05) :241-251

[19] Computing the Bargaining Approach for Equalizing the Ratios of Maximal Gains in Continuous-Time Markov Chains Games [J].

Kristal K. Trejo ;

Julio B. Clempner ;

Alexander S. Poznyak .

Computational Economics, 2019, 54 :933-955

[20] Central limit theorems for ergodic continuous-time Markov chains with applications to single birth processes [J].

Liu, Yuanyuan ;

Zhang, Yuhui .

FRONTIERS OF MATHEMATICS IN CHINA, 2015, 10 (04) :933-947

← 1 2 3 4 5 →