Minimizing risk models in stochastic shortest path problems

被引:18
作者
Ohtsubo, Y [1 ]
机构
[1] Kochi Univ, Dept Math, Kochi 7808520, Japan
关键词
shortest path problem; minimizing risk model; Markov decision process;
D O I
10.1007/s001860200246
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We consider a minimizing risk model in a stochastic shortest path problem in which for each node of a graph we select a probability distribution over the set of successor nodes so as to reach a given target node with minimum threshold probability. We formulate such a problem as undiscounted finite Markov decision processes. We show that an optimal value function is a unique solution to an optimality equation and find an optimal stationary policy. A value iteration method is also given.
引用
收藏
页码:79 / 88
页数:10
相关论文
共 14 条
[1]  
[Anonymous], J FLUIDS ENG
[2]   AN ANALYSIS OF STOCHASTIC SHORTEST-PATH PROBLEMS [J].
BERTSEKAS, DP ;
TSITSIKLIS, JN .
MATHEMATICS OF OPERATIONS RESEARCH, 1991, 16 (03) :580-595
[3]   TARGET-LEVEL CRITERION IN MARKOV DECISION-PROCESSES [J].
BOUAKIZ, M ;
KEBIR, Y .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1995, 86 (01) :1-15
[4]   ON SEQUENTIAL DECISIONS AND MARKOV-CHAINS [J].
DERMAN, C .
MANAGEMENT SCIENCE, 1962, 9 (01) :16-24
[5]  
DERMAN C, 1970, FINITE STATE MARKOVI
[6]   PERCENTILE PERFORMANCE CRITERIA FOR LIMITING AVERAGE MARKOV DECISION-PROCESSES [J].
FILAR, JA ;
KRASS, D ;
ROSS, KW .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1995, 40 (01) :2-10
[7]  
Hernandez-Lerma O., 2012, DISCRETE TIME MARKOV, V30
[8]   Optimal policy for minimizing risk models in Markov decision processes [J].
Ohtsubo, Y ;
Toyonaga, K .
JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2002, 271 (01) :66-81
[9]  
OHTSUBO Y, UNPUB EQUIVALENCE CL
[10]   ROUTING-PROBLEMS AND MARKOVIAN DECISION-PROCESSES [J].
SANCHO, NGF .
JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 1985, 105 (01) :76-83