Probabilistic solutions to optimal control problems

被引:0
作者
Lefebvre, M [1 ]
机构
[1] Ecole Polytech Montreal, Dept Math & Genie Ind, Montreal, PQ H3C 3A7, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Brownian motion; dynamic programming equation; hitting time; homing problem; Kolmogorov backward equation; stochastic control;
D O I
10.1080/02331930211987
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
Let (x(1)(t),x(2)(t)) be a controlled two-dimensional diffusion process. The problem of minimizing, or maximizing, the time spent by (x(1)(t),x(2)(t)) in a given subset of R-2 is solved, in two particular instances, by transforming the optimal control problems into purely probabilistic problems. In Section 2, (x(1)(t),x(2)(t)) is a two-dimensional Wiener process and the optimal control is obtained by transforming a nonlinear dynamic programming equation into the Kolmogorov backward equation for a two-dimensional geometric Brownian motion. In Section 3, the converse problem is solved. The problem of finding the maximal instantaneous reward that we can give for survival in the continuation region is also treated.
引用
收藏
页码:145 / 160
页数:16
相关论文
共 10 条
[1]  
Cox DR., 1965, The Theory of Stochastic Proceesses, DOI DOI 10.1016/J.PHYSA.2011
[2]  
Karlin S., 1981, 2 COURSE STOCHASTIC
[3]   THE RISK-SENSITIVE HOMING PROBLEM [J].
KUHN, J .
JOURNAL OF APPLIED PROBABILITY, 1985, 22 (04) :796-803
[4]   STOCHASTIC BARGAINING MODELS [J].
LEFEBVRE, M ;
MAZIGH, M .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1995, 84 (02) :377-391
[5]   Using a geometric Brownian motion to control a Brownian motion and vice versa [J].
Lefebvre, M .
STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 1997, 69 (01) :71-82
[6]  
LEFEBVRE M, 1997, OPTIMIZATION, V42, P125
[7]  
LEFEBVRE M, 1996, ANN UMCS A, V50, P99
[8]  
Ross S.M., 1997, INTRO PROBABILITY MO
[9]  
Whittle P, 1990, RISK SENSITIVE OPTIM
[10]  
Whittle P., 1982, Dynamic Programming and Stochastic Control, V1