Degenerate stochastic control problems with exponential costs and weakly coupled dynamics:: Viscosity solutions and a maximum principle

被引:3
作者
Huang, MY
Caines, PE
Malhamé, RP
机构
[1] McGill Univ, Dept Elect & Comp Engn, Montreal, PQ H3A 2A7, Canada
[2] Ecole Polytech, Dept Elect Engn, Montreal, PQ H3C 3A7, Canada
[3] GERAD, Montreal, PQ, Canada
关键词
degenerate stochastic control; power control; HJB equations; dynamic programming; viscosity solutions;
D O I
10.1137/S0363012902417644
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper considers a class of optimization problems arising in wireless communication systems. We analyze the optimal control and the associated Hamilton - Jacobi - Bellman (HJB) equations. It turns out that the value function is a unique viscosity solution of the HJB equation in a certain function class. To deal with the fast growth condition of the value function in establishing uniqueness, we construct particular semiconvex/semiconcave approximations for the viscosity sub/supersolutions, and obtain a maximum principle on unbounded domains. The localized envelope function technique introduced in this paper permits an analysis of the uniqueness of viscosity solutions defined on unbounded domains in cases with very general growth conditions when combined with appropriate system dynamics. The optimization problem with state constraints is also considered.
引用
收藏
页码:367 / 387
页数:21
相关论文
共 12 条
[1]  
Charalambous C. D., 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304), P4947, DOI 10.1109/CDC.1999.833330
[2]   USERS GUIDE TO VISCOSITY SOLUTIONS OF 2ND-ORDER PARTIAL-DIFFERENTIAL EQUATIONS [J].
CRANDALL, MG ;
ISHII, H ;
LIONS, PL .
BULLETIN OF THE AMERICAN MATHEMATICAL SOCIETY, 1992, 27 (01) :1-67
[3]  
Fleming W., 2006, CONTROLLED MARKOV PR
[4]  
Fleming WH., 1975, SPRINGER
[5]   CORRELATION MODEL FOR SHADOW FADING IN MOBILE RADIO SYSTEMS [J].
GUDMUNDSON, M .
ELECTRONICS LETTERS, 1991, 27 (23) :2145-2146
[6]  
Huang M, 2001, P AMER CONTR CONF, P750, DOI 10.1109/ACC.2001.945805
[7]   Uplink power adjustment in wireless communication systems:: A stochastic control analysis [J].
Huang, MY ;
Caines, PE ;
Malhamé, RP .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2004, 49 (10) :1693-1708
[8]  
Huang MY, 2001, IEEE DECIS CONTR P, P1037, DOI 10.1109/CDC.2001.981021
[9]   ON UNIQUENESS AND EXISTENCE OF VISCOSITY SOLUTIONS OF FULLY NONLINEAR 2ND-ORDER ELLIPTIC PDES [J].
ISHII, H .
COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 1989, 42 (01) :15-45
[10]   A UNIQUENESS RESULT FOR VISCOSITY SOLUTIONS OF 2ND ORDER FULLY NONLINEAR PARTIAL-DIFFERENTIAL EQUATIONS [J].
JENSEN, R ;
LIONS, PL ;
SOUGANIDIS, PE .
PROCEEDINGS OF THE AMERICAN MATHEMATICAL SOCIETY, 1988, 102 (04) :975-978