Time-inconsistent stochastic optimal control problems and backward stochastic volterra integral equations

被引:23
作者
Wang, Hanxiao [1 ]
Yong, Jiongmin [2 ]
机构
[1] Natl Univ Singapore, Dept Math, Singapore 119076, Singapore
[2] Univ Cent Florida, Dept Math, Orlando, FL 32816 USA
关键词
Time-inconsistent optimal control problem; backward stochastic Volterra integral equation; stochastic differential games; equilibrium strategy; equilibrium Hamilton-Jacobi-Bellman equation;
D O I
10.1051/cocv/2021027
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
An optimal control problem is considered for a stochastic differential equation with the cost functional determined by a backward stochastic Volterra integral equation (BSVIE, for short). This kind of cost functional can cover the general discounting (including exponential and non-exponential) situations with a recursive feature. It is known that such a problem is time-inconsistent in general. Therefore, instead of finding a global optimal control, we look for a time-consistent locally near optimal equilibrium strategy. With the idea of multi-person differential games, a family of approximate equilibrium strategies is constructed associated with partitions of the time intervals. By sending the mesh size of the time interval partition to zero, an equilibrium Hamilton-Jacobi-Bellman (HJB, for short) equation is derived, through which the equilibrium value function and an equilibrium strategy are obtained. Under certain conditions, a verification theorem is proved and the well-posedness of the equilibrium HJB is established. As a sort of Feynman-Kac formula for the equilibrium HJB equation, a new class of BSVIEs (containing the diagonal value Z(r, r) of Z(. , .)) is naturally introduced and the well-posedness of such kind of equations is briefly presented.
引用
收藏
页数:40
相关论文
共 50 条
[41]   Comparison theorems for some backward stochastic Volterra integral equations [J].
Wang, Tianxiao ;
Yong, Jiongmin .
STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2015, 125 (05) :1756-1798
[42]   Non-Lipschitz backward stochastic volterra type equations with jumps [J].
Wang, Zhidong ;
Zhang, Xicheng .
STOCHASTICS AND DYNAMICS, 2007, 7 (04) :479-496
[43]   TIME-INCONSISTENT RECURSIVE STOCHASTIC OPTIMAL CONTROL PROBLEMS [J].
Wei, Qingmeng ;
Yong, Jiongmin ;
Yu, Zhiyong .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2017, 55 (06) :4156-4201
[44]  
Yan W., 2019, Modeling, Stochastic Control, Optimization, and Applications, V164, P533
[45]  
Yong J., 2017, Sci. Sin., Math., V47, P1
[46]   Well-posedness and regularity of backward stochastic Volterra integral equations [J].
Yong, Jiongmin .
PROBABILITY THEORY AND RELATED FIELDS, 2008, 142 (1-2) :21-77
[47]  
Yong J, 2014, PROCEEDINGS OF THE INTERNATIONAL CONGRESS OF MATHEMATICIANS (ICM 2014), VOL IV, P947
[48]   LINEAR-QUADRATIC OPTIMAL CONTROL PROBLEMS FOR MEAN-FIELD STOCHASTIC DIFFERENTIAL EQUATIONS - TIME-CONSISTENT SOLUTIONS [J].
Yong, Jiongmin .
TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY, 2017, 369 (08) :5467-5523
[49]   TIME-INCONSISTENT OPTIMAL CONTROL PROBLEMS AND THE EQUILIBRIUM HJB EQUATION [J].
Yong, Jiongmin .
MATHEMATICAL CONTROL AND RELATED FIELDS, 2012, 2 (03) :271-329
[50]   Stochastic near-optimal controls: Necessary and sufficient conditions for near-optimality [J].
Zhou, XY .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1998, 36 (03) :929-947