SMOOTHED PERTURBATION ANALYSIS DERIVATIVE ESTIMATION FOR MARKOV-CHAINS

被引：17

作者：

FU, MC ^{[1
]}

HU, JQ ^{[1
]}

机构：

[1] BOSTON UNIV,DEPT MFG ENGN,BOSTON,MA 02215

来源：

OPERATIONS RESEARCH LETTERS | 1994年 / 15卷 / 05期

基金：

美国国家科学基金会;

关键词：

SENSITIVITY ANALYSIS; DERIVATIVE ESTIMATION; PERTURBATION ANALYSIS; MARKOV CHAINS;

D O I：

10.1016/0167-6377(94)90084-1

中图分类号：

C93 [管理学]; O22 [运筹学];

学科分类号：

070105 ; 12 ; 1201 ; 1202 ; 120202 ;

摘要：

Using the technique of smoothed perturbation analysis, we consider steady-state performance measures for continuous-time Markov chains and derive a derivative estimator that can be estimated from a single sample path of the chain under consideration. The estimator is applicable to multi-class queueing networks, for which previous infinitesimal perturbation analysis estimators failed. A simple multi-class queueing network is used to illustrate the application of the estimator.

引用

收藏

页码：241 / 251

页数：11

相关论文

共 50 条

[21] MEAN PASSAGE TIMES AND NEARLY UNCOUPLED MARKOV-CHAINS [J].

HASSIN, R ;

HAVIV, M .

SIAM JOURNAL ON DISCRETE MATHEMATICS, 1992, 5 (03) :386-397

[22] RENORMALIZATION-GROUP FOR MARKOV-CHAINS AND APPLICATION TO METASTABILITY [J].

SCOPPOLA, E .

JOURNAL OF STATISTICAL PHYSICS, 1993, 73 (1-2) :83-121

[23] Perturbation analysis for denumerable Markov chains with application to queueing models [J].

Altman, E ;

Avrachenkov, KE ;

Núñez-Queija, R .

ADVANCES IN APPLIED PROBABILITY, 2004, 36 (03) :839-853

[24] Perturbation analysis of continuous-time absorbing Markov chains [J].

Caswell, Hal .

NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS, 2011, 18 (06) :901-917

[25] Blockwise perturbation theory for Markov chains [J].

Xue, JG ;

Gao, WG .

SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 1998, 20 (01) :270-278

[26] PHASE-TYPE DISTRIBUTIONS AND THE STRUCTURE OF FINITE MARKOV-CHAINS [J].

MAIER, RS .

JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 1993, 46 (03) :449-453

[27] ANALYSES OF SPARES FOR NEW WEAPONS SYSTEMS USING MARKOV-CHAINS [J].

WHITE, CR .

EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 1993, 66 (01) :124-134

[28] COMPUTING CUMULATIVE MEASURES OF STIFF MARKOV-CHAINS USING AGGREGATION [J].

BOBBIO, A ;

TRIVEDI, K .

IEEE TRANSACTIONS ON COMPUTERS, 1990, 39 (10) :1291-1298

[29] HYBRID APPROACH TO SPEECH RECOGNITION USING HIDDEN MARKOV-MODELS AND MARKOV-CHAINS [J].

DAI, J .

IEE PROCEEDINGS-VISION IMAGE AND SIGNAL PROCESSING, 1994, 141 (05) :273-279

[30] PERTURBATION BOUNDS FOR THE STATIONARY DISTRIBUTIONS OF MARKOV CHAINS [J].

Liu, Yuanyuan .

SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2012, 33 (04) :1057-1074

← 1 2 3 4 5 →