Constrained Markov control processes in Borel spaces:: the discounted case

被引:43
作者
Hernández-Lerma, O
González-Hernández, J
机构
[1] Inst Politecn Nacl, Ctr Invest & Estudios Avanzados, Dept Matemat, Mexico City 07000, DF, Mexico
[2] Univ Nacl Autonoma Mexico, IIMAS, Dept Probabilidad & Estadist, Mexico City 01000, DF, Mexico
关键词
constrained Markov control processes; discounted cost criterion; infinite-dimensional linear programming;
D O I
10.1007/s001860000071
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We consider constrained discounted-cost Markov control processes in Borel spaces, with unbounded costs. Conditions are given for the constrained problem to be solvable, and also equivalent to an equality-constrained (EC) linear program. In addition, it is shown that there is no duality gap between EC and its dual program EC*, and that, under additional assumptions, also EC* is solvable, so that in fact the strong duality condition holds. Finally, a Farkas-like theorem is included, which gives necessary and sufficient conditions for the primal program EC to be consistent.
引用
收藏
页码:271 / 285
页数:15
相关论文
共 28 条
[1]  
Anderson EJ, 1987, LINEAR PROGRAMMING I
[2]  
[Anonymous], INTEGRATION
[3]  
[Anonymous], CONSTRAINED MARKOV D
[4]  
Billingsley P, 1968, CONVERGE PROBAB MEAS
[5]   ERGODIC CONTROL OF MARKOV-CHAINS WITH CONSTRAINTS - THE GENERAL-CASE [J].
BORKAR, VS .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1994, 32 (01) :176-186
[6]   GENERALIZATIONS OF FARKAS THEOREM [J].
CRAVEN, BD ;
KOLIHA, JJ .
SIAM JOURNAL ON MATHEMATICAL ANALYSIS, 1977, 8 (06) :983-997
[7]  
Dynkin E.B., 1979, Grundlehren der Mathematischen Wissenschaften, V235
[8]   Constrained discounted dynamic programming [J].
Feinberg, EA ;
Shwartz, A .
MATHEMATICS OF OPERATIONS RESEARCH, 1996, 21 (04) :922-945
[9]   Constrained dynamic programming with two discount factors: Applications and an algorithm [J].
Feinberg, EA ;
Shwartz, A .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1999, 44 (03) :628-631
[10]   Envelopes of sets of measures, tightness, and Markov control processes [J].
González-Hernández, J ;
Hernández-Lerma, O .
APPLIED MATHEMATICS AND OPTIMIZATION, 1999, 40 (03) :377-392