On existence of limit occupational measures set of a controlled stochastic differential equation

被引:22
作者
Borkar, V
Gaitsgory, V
机构
[1] Tata Inst Fundamental Res, Sch Technol & Comp Sci, Bombay 400005, Maharashtra, India
[2] Univ S Australia, Sch Math, Mawson Lakes, SA 5095, Australia
关键词
singularly perturbed controlled stochastic differential equations; occupational measures; averaging method; limit occupational measures sets; approximation of slow motions;
D O I
10.1137/S0363012904443476
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We establish that, under certain conditions, the set of occupational measures as well as the set of mathematical expectations of occupational measures generated by the admissible controls and the corresponding solutions of a controlled stochastic differential equation (CSDE) converge ( with the time horizon tending to infinity) to a set called limit occupational measures set (LOMS) and we show that this limit set coincides with the set of stationary marginal distributions of the CSDE. We also demonstrate the applicability of our results for averaging of singularly perturbed CSDE.
引用
收藏
页码:1436 / 1473
页数:38
相关论文
共 53 条
[1]   Asymptotic optimization of a nonlinear hybrid system governed by a Markov decision process [J].
Altman, E ;
Gaitsgory, V .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1997, 35 (06) :2070-2085
[2]   Singular perturbations of nonlinear degenerate parabolic PDEs: A general convergence result [J].
Alvarez, O ;
Bardi, M .
ARCHIVE FOR RATIONAL MECHANICS AND ANALYSIS, 2003, 170 (01) :17-61
[3]   Viscosity solutions methods for singular perturbations in deterministic and stochastic control [J].
Alvarez, O ;
Bardi, M .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2001, 40 (04) :1159-1188
[4]  
[Anonymous], 1999, DIFFERENTIAL EQUATIO
[5]  
[Anonymous], AVERAGING SYSTEMS DI
[6]  
[Anonymous], LECT NOTES MATH
[7]  
[Anonymous], 1991, CONTROL SYSTEMS SLOW
[8]  
Artstein Z, 1997, SIAM J CONTROL OPTIM, V35, P1487
[9]  
Artstein Z, 2002, CONTROL CYBERN, V31, P623
[10]   Singularly perturbed control systems with one-dimensional fast dynamics [J].
Artstein, Z ;
Leizarowitz, A .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2002, 41 (02) :641-658