Markov control processes with randomized discounted cost

被引:22
作者
Gonzalez-Hernandez, Juan
Lopez-Martinez, Raquiel R.
Ruben Perez-Hernandez, J.
机构
[1] Fac Matemat UV, Xalapa 91090, Veracruz, Mexico
[2] Univ Nacl Autonoma Mexico, IIMAS, Dept Probabil & Estadist, Mexico City 01000, DF, Mexico
[3] IPN, UPIITA, Dept Ciencias Basicas, Mexico City 07738, DF, Mexico
关键词
Markov decision processes; discounted cost; random rate; dynamic programming;
D O I
10.1007/s00186-006-0092-2
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In this paper we consider Markov Decision Processes with discounted cost and a random rate in Borel spaces. We establish the dynamic programming algorithm in finite and infinity horizon cases. We provide conditions for the existence of measurable selectors. And we show an example of consumption-investment problem.
引用
收藏
页码:27 / 44
页数:18
相关论文
共 29 条
[1]   Hierarchical algorithms for discounted and weighted Markov decision processes [J].
Abbad, M ;
Daoui, C .
MATHEMATICAL METHODS OF OPERATIONS RESEARCH, 2003, 58 (02) :237-245
[2]  
[Anonymous], CONSTRAINED MARKOV D
[3]  
Bertsekas DP, 2012, DYNAMIC PROGRAMMING, V2
[4]   The effects of different inflation risk premiums on interest rate spreads [J].
Berument, H ;
Kilinc, Z ;
Ozlale, U .
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2004, 333 (1-4) :317-324
[5]  
BORKAR VS, 1991, TOPICS CONTROLLED MA
[6]   Ruin probabilities with a Markov chain interest model [J].
Cai, J ;
Dickson, DCM .
INSURANCE MATHEMATICS & ECONOMICS, 2004, 35 (03) :513-525
[7]   CONSTRAINED MARKOV DECISION-MODELS WITH WEIGHTED DISCOUNTED REWARDS [J].
FEINBERG, EA ;
SHWARTZ, A .
MATHEMATICS OF OPERATIONS RESEARCH, 1995, 20 (02) :302-320
[8]   Constrained dynamic programming with two discount factors: Applications and an algorithm [J].
Feinberg, EA ;
Shwartz, A .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1999, 44 (03) :628-631
[9]   MARKOV DECISION-MODELS WITH WEIGHTED DISCOUNTED CRITERIA [J].
FEINBERG, EA ;
SHWARTZ, A .
MATHEMATICS OF OPERATIONS RESEARCH, 1994, 19 (01) :152-168
[10]  
GIL A, 2004, Q REV EC FINANCE, V44, P475