Optimal interventions in countable jump Markov processes

被引:4
作者
Piunovskiy, AB [1 ]
机构
[1] Univ Liverpool, Dept Math Sci, Liverpool L69 7ZL, Merseyside, England
关键词
point process; stochastic optimal control; Markov decision process; constrained optimization; epidemic with carriers;
D O I
10.1287/moor.1030.0063
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In this paper an intervention refers to an immediate change of the state of the system; between interventions, the continuous-time jump Markov process is uncontrollable, with "natural" jump intensities. The multicriteria control problem for such a model is considered, and the constrained version is investigated with the help of the Lagrange multipliers technique. All of the theory is illustrated by an example of the optimal control of epidemic with carriers.
引用
收藏
页码:289 / 308
页数:20
相关论文
共 19 条
[1]  
Abakuks A., 1974, ADV APPL PROBAB, V6, P494, DOI DOI 10.2307/1426230
[2]  
ABAKUKS AD, 1972, THESIS U SUSSEX SUSS
[3]  
Altman E., 1999, STOCH MODEL SER
[4]  
[Anonymous], STOCH STOCH REP
[5]  
Bertsekas D. P., 1996, Neuro-dynamic programming
[6]   Optimal maintenance policy for a Markovian system under periodic inspection [J].
Chiang, JH ;
Yuan, J .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2001, 71 (02) :165-172
[7]  
FEINBERG EA, 2004, IN PRESS MATH OPER R
[8]   On constrained Markov decision processes [J].
Haviv, M .
OPERATIONS RESEARCH LETTERS, 1996, 19 (01) :25-28
[9]  
Hernandez-Lerma O., 1999, FURTHER TOPICS DISCR
[10]   CONSTRAINED ADMISSION CONTROL TO A QUEUING SYSTEM [J].
HORDIJK, A ;
SPIEKSMA, F .
ADVANCES IN APPLIED PROBABILITY, 1989, 21 (02) :409-431