Singular control with state constraints on unbounded domain

被引:14
作者
Atar, Rami [1 ]
Budhiraja, Amarjit
机构
[1] Technion Israel Inst Technol, Dept Elect Engn, IL-32000 Haifa, Israel
[2] Univ N Carolina, Dept Stat, Chapel Hill, NC 27599 USA
关键词
singular control; state constraints; viscosity solutions; Hamilton-Jacobi-Bellman equations; Skorchod problem; Brownian control problems; stochastic networks;
D O I
10.1214/009117906000000359
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We study a class of stochastic control problems where a cost of the form E integral([0,infinity)) e(-beta s) [l(X-S)ds + h (Y-S degrees) d vertical bar Y vertical bar(s)] is to be minimized over control processes Y whose increments take values in a cone Y of RP, keeping the state process X = x + B + G Y in a cone X of R-k, k <= p. Here, x c X, B is a Brownian motion with drift b and covariance E, G is a fixed matrix, and Y degrees is the Radon-Nikodym derivative dY vertical bar d vertical bar Y vertical bar. Let L = -(1/2)trace(Sigma D-2) - b (.) D where D denotes the gradient. Solutions to the corresponding dynamic programming PDE, [(L + beta)f - l]v sup [-Gy (.) Df - h(y)] = 0, y epsilon Y:vertical bar Gy vertical bar = 1 on X degrees are considered with a polynomial growth condition and are required to be supersolution up to the boundary (corresponding to a "state constraint" boundary condition on partial derivative X). Under suitable conditions on the problem data, including continuity and nonnegativity of e and h, and polynomial growth of l, our main result is the unique viscosity-sense solvability of the PDE by the control problem's value function in appropriate classes of functions. In some cases where uniqueness generally fails to hold in the class of functions that grow at most polynomially (e.g., when h = 0), our methods provide uniqueness within the class of functions that, in addition, have compact level sets. The results are new even in the following special cases: (1) The one-dimensional case k = p = 1, X = Y = R+; (2) The first-order case Sigma = 0; (3) The case where E and h are linear. The proofs combine probabilistic arguments and viscosity solution methods. Our framework covers a wide range of diffusion control problems that arise from queueing networks in heavy traffic.
引用
收藏
页码:1864 / 1909
页数:46
相关论文
共 34 条
[1]  
[Anonymous], 1997, Optimal control and viscosity solutions of Hamilton-Jacobi-Bellman equations
[2]  
Benes V. E., 1980, Stochastics, V4, P39, DOI 10.1080/17442508008833156
[3]  
BOHM V, 1975, SIAM J APPL MATH, V28, P303, DOI 10.1137/0128026
[4]  
Borkar VS, 1989, PITMAN RES NOTES MAT, V203, P213
[5]   Two workload properties for Brownian networks [J].
Bramson, M ;
Williams, RJ .
QUEUEING SYSTEMS, 2003, 45 (03) :191-221
[6]   HAMILTON-JACOBI EQUATIONS WITH STATE CONSTRAINTS [J].
CAPUZZODOLCETTA, I ;
LIONS, PL .
TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY, 1990, 318 (02) :643-683
[7]   ADDITIVE CONTROL OF STOCHASTIC LINEAR-SYSTEMS WITH FINITE-HORIZON [J].
CHOW, PL ;
MENALDI, JL ;
ROBIN, M .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1985, 23 (06) :858-899
[8]   REMARKS ON THE EXISTENCE AND UNIQUENESS OF UNBOUNDED VISCOSITY SOLUTIONS OF HAMILTON-JACOBI EQUATIONS [J].
CRANDALL, MG ;
LIONS, PL .
ILLINOIS JOURNAL OF MATHEMATICS, 1987, 31 (04) :665-688
[9]   USERS GUIDE TO VISCOSITY SOLUTIONS OF 2ND-ORDER PARTIAL-DIFFERENTIAL EQUATIONS [J].
CRANDALL, MG ;
ISHII, H ;
LIONS, PL .
BULLETIN OF THE AMERICAN MATHEMATICAL SOCIETY, 1992, 27 (01) :1-67
[10]   Hedging in incomplete markers with HARA utility [J].
Duffie, D ;
Fleming, W ;
Soner, HM ;
Zariphopoulou, T .
JOURNAL OF ECONOMIC DYNAMICS & CONTROL, 1997, 21 (4-5) :753-782