A global maximum principle for stochastic optimal control problems with delay and applications

被引:16
作者
Meng, Weijun [1 ]
Shi, Jingtao [1 ]
机构
[1] Shandong Univ, Sch Math, Jinan 250100, Peoples R China
基金
国家重点研发计划;
关键词
Stochastic optimal control; Stochastic differential delay equations; Anticipated backward stochastic differential equation; Maximum principle; Linear-quadratic control;
D O I
10.1016/j.sysconle.2021.104909
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, an open problem is solved, for the stochastic optimal control problem with delay where the control domain is nonconvex and the diffusion term contains both control and its delayed term. Inspired by previous results about delayed stochastic control systems, Peng's global stochastic maximum principle is generalized to the time delayed case. A special backward stochastic differential equation is introduced to deal with the cross terms, when applying the duality technique. Comparing with the classical result, the maximum condition contains an indicator function, which in fact is the characteristic of the stochastic optimal control problem with delay. Furthermore, to illustrate the applications of our theoretical results, three dynamic optimization problems are addressed based on the global maximum principle. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 35 条
[1]   A MAXIMUM PRINCIPLE FOR INFINITE HORIZON DELAY EQUATIONS [J].
Agram, N. ;
Haadem, S. ;
Oksendal, B. ;
Proske, F. .
SIAM JOURNAL ON MATHEMATICAL ANALYSIS, 2013, 45 (04) :2499-2522
[2]  
[Anonymous], STOCHASTIC FUNCTIONA
[3]  
[Anonymous], 1996, PROGR PROBABILITY
[4]  
BENSOUSSAN A, 1982, LECT NOTES MATH, V972, P1
[5]   INTRODUCTORY APPROACH TO DUALITY IN OPTIMAL STOCHASTIC CONTROL [J].
BISMUT, JM .
SIAM REVIEW, 1978, 20 (01) :62-78
[6]   Stochastic Optimal Control Problem in Advertising Model with Delay [J].
Chen Li ;
Wu Zhen .
JOURNAL OF SYSTEMS SCIENCE & COMPLEXITY, 2020, 33 (04) :968-987
[7]   Stochastic Maximum Principle for Controlled Backward Delayed System via Advanced Stochastic Differential Equation [J].
Chen, Li ;
Huang, Jianhui .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2015, 167 (03) :1112-1135
[8]   Maximum Principle for Nonzero-Sum Stochastic Differential Game With Delays [J].
Chen, Li ;
Yu, Zhiyong .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2015, 60 (05) :1422-1426
[9]   Maximum principle for the stochastic optimal control problem with delay and application [J].
Chen, Li ;
Wu, Zhen .
AUTOMATICA, 2010, 46 (06) :1074-1080
[10]   A Stochastic Maximum Principle for Delayed Mean-Field Stochastic Differential Equations and Its Applications [J].
Du, Heng ;
Huang, Jianhui ;
Qin, Yongli .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2013, 58 (12) :3212-3217