STOCHASTIC MINIMUM PRINCIPLE FOR PARTIALLY OBSERVED SYSTEMS SUBJECT TO CONTINUOUS AND JUMP DIFFUSION PROCESSES AND DRIVEN BY RELAXED CONTROLS

被引:22
作者
Ahmed, N. U. [1 ]
Charalambous, Charalambos D. [2 ]
机构
[1] Univ Ottawa, Sch Engn & Comp Sci, Ottawa, ON K1N 6N5, Canada
[2] Univ Cyprus, Dept Elect & Comp Engn, Nicosia, Cyprus
关键词
stochastic differential equations; continuous diffusion; jump processes; relaxed controls; existence of optimal controls; necessary conditions of optimality; MAXIMUM PRINCIPLE;
D O I
10.1137/120885656
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we consider nonconvex control problems of stochastic differential equations driven by relaxed controls adapted, in the weak star sense, to a current of sigma algebras generated by observable processes. We cover in a unified way both continuous diffusion and jump processes. We present existence of optimal controls before we construct the necessary conditions of optimality (unlike some papers in this area) using only functional analysis. We develop a stochastic Hamiltonian system of equations on a rigorous basis using the semimartingale representation theory and the Riesz representation theorem, leading naturally to the existence of the adjoint process which satisfies a backward stochastic differential equation. In other words, our approach predicts the existence of the adjoint process as a natural consequence of Riesz representation theory ensuring at the same time the (weak star) measurability. This is unlike other papers, where the adjoint process is introduced before its existence is proved. We believe this is one of our major contributions in this paper. We also discuss the realizability of relaxed controls by regular controls using the Krein-Millman theorem. We believe this is another major contribution of this paper. We also believe that our approach is direct and easy to understand following simply the precise logic of functional analysis.
引用
收藏
页码:3235 / 3257
页数:23
相关论文
共 33 条
[1]   Minimax games for stochastic systems subject to relative entropy uncertainty: applications to SDEs on Hilbert spaces [J].
Ahmed, N. U. ;
Charalambous, C. D. .
MATHEMATICS OF CONTROL SIGNALS AND SYSTEMS, 2007, 19 (01) :65-91
[2]  
Ahmed N. U., 1981, OPTIMAL CONTROL DIST
[3]  
Ahmed N. U., 2005, NONLINEAR FUNCT ANAL, V10, P427
[4]  
Ahmed NasirUddin., 2006, Dynamic Systems and Control with Applications
[5]  
[Anonymous], 1999, Encyclopedia Math. Appl.
[6]  
[Anonymous], 1991, STOCHASTICS STOCHAST
[7]   A maximum principle for stochastic control with partial information [J].
Baghery, Fouzia ;
Oksendal, Bernt .
STOCHASTIC ANALYSIS AND APPLICATIONS, 2007, 25 (03) :705-717
[8]   On the stochastic maximum principle in optimal control of degenerate diffusions with lipschitz coefficients [J].
Bahlali, Khaled ;
Djehiche, Boualem ;
Mezerdi, Brahim .
APPLIED MATHEMATICS AND OPTIMIZATION, 2007, 56 (03) :364-378
[9]  
BAHLALI S, 2006, J APPL MATH STOCH AN, P1
[10]   Necessary and sufficient optimality conditions for relaxed and strict control problems [J].
Bahlali, Seid .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2008, 47 (04) :2078-2095