SMOOTHED PERTURBATION ANALYSIS DERIVATIVE ESTIMATION FOR MARKOV-CHAINS

被引：17

作者：

FU, MC ^{[1
]}

HU, JQ ^{[1
]}

机构：

[1] BOSTON UNIV,DEPT MFG ENGN,BOSTON,MA 02215

来源：

OPERATIONS RESEARCH LETTERS | 1994年 / 15卷 / 05期

基金：

美国国家科学基金会;

关键词：

SENSITIVITY ANALYSIS; DERIVATIVE ESTIMATION; PERTURBATION ANALYSIS; MARKOV CHAINS;

D O I：

10.1016/0167-6377(94)90084-1

中图分类号：

C93 [管理学]; O22 [运筹学];

学科分类号：

070105 ; 12 ; 1201 ; 1202 ; 120202 ;

摘要：

Using the technique of smoothed perturbation analysis, we consider steady-state performance measures for continuous-time Markov chains and derive a derivative estimator that can be estimated from a single sample path of the chain under consideration. The estimator is applicable to multi-class queueing networks, for which previous infinitesimal perturbation analysis estimators failed. A simple multi-class queueing network is used to illustrate the application of the estimator.

引用

页码：241 / 251

页数：11

共 50 条

[1] PERTURBATION MODEL IN MARKOV-CHAINS
RUBINSTEIN, E
SOUTH AFRICAN STATISTICAL JOURNAL, 1979, 13 (02) : 189 - 190
[2] SINGULAR PERTURBATION OF MARKOV-CHAINS
DELEBECQUE, F
MURON, O
QUADRAT, JP
LECTURE NOTES IN CONTROL AND INFORMATION SCIENCES, 1987, 90 : 263 - 287
[3] DISCRETE-TIME INVERSION AND DERIVATIVE ESTIMATION FOR MARKOV-CHAINS
GLASSERMAN, P
OPERATIONS RESEARCH LETTERS, 1990, 9 (05) : 305 - 313
[4] ENTRYWISE PERTURBATION-THEORY AND ERROR ANALYSIS FOR MARKOV-CHAINS
OCINNEIDE, CA
NUMERISCHE MATHEMATIK, 1993, 65 (01) : 109 - 120
[5] SENSITIVITY OF FINITE MARKOV-CHAINS UNDER PERTURBATION
SENETA, E
STATISTICS & PROBABILITY LETTERS, 1993, 17 (02) : 163 - 168
[6] ON THE PERTURBATION OF MARKOV-CHAINS WITH NEARLY TRANSIENT STATES
STEWART, GW
NUMERISCHE MATHEMATIK, 1993, 65 (01) : 135 - 141
[7] ANALYSIS OF AN IDENTIFICATION ALGORITHM ARISING IN THE ADAPTIVE ESTIMATION OF MARKOV-CHAINS
ARAPOSTATHIS, A
MARCUS, SI
MATHEMATICS OF CONTROL SIGNALS AND SYSTEMS, 1990, 3 (01) : 1 - 29
[8] A SINGULAR PERTURBATION APPROACH TO MODELING AND CONTROL OF MARKOV-CHAINS
PHILLIPS, RG
KOKOTOVIC, PV
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1981, 26 (05) : 1087 - 1094
[9] CONSISTENT ESTIMATION OF THE ORDER OF HIDDEN MARKOV-CHAINS
BARAS, JS
FINESSO, L
LECTURE NOTES IN CONTROL AND INFORMATION SCIENCES, 1992, 184 : 26 - 39
[10] ESTIMATION IN ACCOUNTING AND AUDITING USING MARKOV-CHAINS
BARKMAN, AI
JOURNAL OF ACCOUNTANCY, 1977, 144 (06): : 75 - 79

← 1 2 3 4 5 →