First passage times for multidimensional denumerable state Markov processes

被引：0

作者：

Xu, GH ^{[1
]}

Xu, DJ

机构：

[1] Chinese Acad Sci, Inst Appl Math, Beijing 100080, Peoples R China

[2] CAS, Asian Pacific Operat Res Ctr, Beijing 100080, Peoples R China

[3] APORS, Beijing 100080, Peoples R China

来源：

CHINESE SCIENCE BULLETIN | 1999年 / 44卷 / 11期

关键词：

multidimensional denumerable state Markov process; first passage time; uniformization; uniform error;

D O I：

10.1007/BF02886012

中图分类号：

O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];

学科分类号：

07 ; 0710 ; 09 ;

摘要：

For a general multidimensional denumerable state Markov process with any initial state probability vector, the probability density function and its LS transform of the first passage time to a certain given state set are obtained and the algorithms for them are derived. It is proved that the resulting errors of the algorithms are both uniform in their respective arguments. Some numerical results are presented.

引用

页码：970 / 980

页数：11

共 50 条

[31] Nonstationary denumerable state Markov decision processes – with average variance criterion
Xianping Guo
Mathematical Methods of Operations Research, 1999, 49 (1) : 87 - 96
[32] Computation of First Passage of Markov Additive Processes
Changli Liu
Jungong Xue
Junxin Zhang
Journal of Scientific Computing, 2025, 103 (3)
[33] Mean first passage times in variational coarse graining using Markov state models
Kells, Adam
Mihalka, Zsuzsanna E.
Annibale, Alessia
Rosta, Edina
JOURNAL OF CHEMICAL PHYSICS, 2019, 150 (13):
[34] FINITE-STATE APPROXIMATIONS FOR DENUMERABLE STATE DISCOUNTED MARKOV DECISION-PROCESSES
CAVAZOSCADENA, R
APPLIED MATHEMATICS AND OPTIMIZATION, 1986, 14 (01): : 1 - 26
[35] The computation of the mean first passage times for Markov chains
Hunter, Jeffrey J.
LINEAR ALGEBRA AND ITS APPLICATIONS, 2018, 549 : 100 - 122
[36] Variances of first passage times in a Markov chain with applications to mixing times
Hunter, Jeffrey J.
LINEAR ALGEBRA AND ITS APPLICATIONS, 2008, 429 (5-6) : 1135 - 1162
[37] Comparing first-passage times for semi-Markov skip-free processes
DiCrescenzo, A
Ricciardi, LM
STATISTICS & PROBABILITY LETTERS, 1996, 30 (03) : 247 - 256
[38] Comparing first-passage times for semi-Markov skip-free processes
Stat Probab Lett, 3 (247):
[39] Continuous-state branching processes with collisions: First passage times and duality
Foucart, Clement
Vidmar, Matija
STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2024, 167
[40] SOJOURN TIMES AND FIRST PASSAGE TIMES FOR BIRTH AND DEATH PROCESSES
王梓坤
Science China Mathematics, 1980, (03) : 269 - 279

← 1 2 3 4 5 →