CONNECTEDNESS CONDITIONS USED IN FINITE STATE MARKOV DECISION-PROCESSES

被引：2
作者：
THOMAS, LC
机构：
[1] Department of Decision Theory, University of Manchester, Manchester
来源：
JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS | 1979年 / 68卷 / 02期
关键词：
D O I：
10.1016/0022-247X(79)90135-5
中图分类号：
O29 [应用数学];
学科分类号：
070104 ;
摘要：
This note considers the conditions that have been put on the set of transition matrices of finite state Markov Decision Processes in order to prove the existence of optimal policies, and the convergence of algorithms. It is shown that no two of the nine conditions considered are equivalent. © 1979.
引用
收藏
页码：548 / 556
页数：9
相关论文
共 50 条
[31]   SUCCESSIVE APPROXIMATIONS FOR MARKOV DECISION-PROCESSES [J].
VANNUNEN, JAEE .
ADVANCES IN APPLIED PROBABILITY, 1978, 10 (02) :311-312
[32]   SENSITIVITY ANALYSIS IN MARKOV DECISION-PROCESSES [J].
NOVAK, J .
EKONOMICKO-MATEMATICKY OBZOR, 1987, 23 (01) :89-101
[33]   THE VARIANCE OF DISCOUNTED MARKOV DECISION-PROCESSES [J].
SOBEL, MJ .
JOURNAL OF APPLIED PROBABILITY, 1982, 19 (04) :794-802
[34]   VARIABILITY SENSITIVE MARKOV DECISION-PROCESSES [J].
BAYKALGURSOY, M ;
ROSS, KW .
PROCEEDINGS OF THE 28TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-3, 1989, :1261-1262
[35]   FINITE-HORIZON MARKOV DECISION-PROCESSES WITH UNCERTAIN TERMINAL PAYOFFS [J].
WHITE, DJ .
OPERATIONS RESEARCH, 1995, 43 (05) :862-869
[36]   UTILITY CRITERION FOR MARKOV DECISION-PROCESSES [J].
JAQUETTE, SC .
MANAGEMENT SCIENCE, 1976, 23 (01) :43-49
[37]   REAL APPLICATIONS OF MARKOV DECISION-PROCESSES [J].
WHITE, DJ .
INTERFACES, 1982, 12 (01) :95-95
[38]   A SURVEY OF APPLICATIONS OF MARKOV DECISION-PROCESSES [J].
WHITE, DJ .
JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 1993, 44 (11) :1073-1096
[39]   LEARNING ALGORITHMS FOR MARKOV DECISION-PROCESSES [J].
KURANO, M .
JOURNAL OF APPLIED PROBABILITY, 1987, 24 (01) :270-276
[40]   VARIATIONAL CHARACTERIZATIONS IN MARKOV DECISION-PROCESSES [J].
FEDERGRUEN, A ;
SCHWEITZER, PJ .
JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 1986, 117 (02) :326-357
12345