Stochastic recursive optimal control of McKean-Vlasov type: A viscosity solution approach

被引:0
|
作者
Zhang, Liangquan [1 ]
机构
[1] Renmin Univ China, Sch Math, Beijing 100872, Peoples R China
关键词
Dynamic programming principle; Forward-backward McKean-Vlasov stochastic differential equations; Hamilton-Jacobi-Bellman equation; Wasserstein space; Value function; Viscosity solutions; MEAN-FIELD GAMES; DIFFERENTIAL-EQUATIONS; MAXIMUM PRINCIPLE; BACKWARD SDES; SYSTEMS; RISK; AMBIGUITY;
D O I
10.1016/j.jde.2024.07.015
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
In this paper, we study a kind of optimal control problem for forward-backward stochastic differential equations (FBSDEs for short) of McKean-Vlasov type via the dynamic programming principle (DPP for short) motivated by studying the infinite dimensional Hamilton-Jacobi-Bellman (HJB for short) equation derived from the decoupling field of the FBSDEs posed by Carmona and Delarue (2015) [28]. At the beginning, the value function is defined by the solution to the controlled BSDE alluded to earlier. On one hand, we can prove the value function is deterministic function with respect to the initial random variable; On the other hand, we can show that the value function is law-invariant, i.e., depending on only via its distribution by virtue of BSDE property. Afterward, utilizing the notion of differentiability with respect to probability measures introduced by P.L. Lions [50], we are able to establish a DPP for the value function in the Wasserstein space of probability measures based on the application of BSDE approach, particularly, employing the notion of stochastic backward semigroups associated with stochastic optimal control problems and It & ocirc; formula along a flow property of the conditional law of the controlled forward state process. We prove that the value function is the unique viscosity solutions of the associated generalized HJB equations in some separable Hilbert space. Finally, as an application, we formulate an optimal control problem for linear stochastic differential equations with quadratic cost functionals of McKean-Vlasov type under nonlinear expectation, g-expectation introduced by Peng [43] and derive the optimal feedback control explicitly by means of several groups of Riccati equations. (c) 2024 Elsevier Inc. All rights are reserved, including those for text and data mining, AI training, and similar technologies.
引用
收藏
页码:334 / 394
页数:61
相关论文
共 50 条
  • [41] Strong well posedness of McKean-Vlasov stochastic differential equations with Holder drift
    de Raynal, P. E. Chaudru
    STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2020, 130 (0I) : 79 - 107
  • [42] On optimal singular control problem for general Mckean-Vlasov differential equations: Necessary and sufficient optimality conditions
    Hafayed, Mokhtar
    Meherrem, Shahlar
    Eren, Saban
    Gucoglu, Deniz Hasan
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2018, 39 (03): : 1202 - 1219
  • [43] CONNECTION BETWEEN MP AND DPP FOR STOCHASTIC RECURSIVE OPTIMAL CONTROL PROBLEMS: VISCOSITY SOLUTION FRAMEWORK IN THE GENERAL CASE
    Nie, Tianyang
    Shi, Jingtao
    Wu, Zhen
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2017, 55 (05) : 3258 - 3294
  • [44] Near-Optimal Control of Stochastic Recursive Systems Via Viscosity Solution
    Liangquan Zhang
    Qing Zhou
    Journal of Optimization Theory and Applications, 2018, 178 : 363 - 382
  • [45] McKean-Vlasov stochastic differential equations driven by the time-changed Brownian motion
    Li, Zhi
    Xu, Liping
    Yan, Litan
    JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2023, 527 (01)
  • [46] Strong convergence order for slow-fast McKean-Vlasov stochastic differential equations
    Rockner, Michael
    Sun, Xiaobin
    Xie, Yingchao
    ANNALES DE L INSTITUT HENRI POINCARE-PROBABILITES ET STATISTIQUES, 2021, 57 (01): : 547 - 576
  • [47] Maximum principle for optimal control of McKean-Vlasov FBSDEs with Levy process via the differentiability with respect to probability law
    Meherrem, Shahlar
    Hafayed, Mokhtar
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2019, 40 (03): : 499 - 516
  • [48] An Extended McKean-Vlasov Dynamic Programming Approach to Robust Equilibrium Controls Under Ambiguous Covariance Matrix
    Lei, Qian
    Pun, Chi Seng
    APPLIED MATHEMATICS AND OPTIMIZATION, 2023, 88 (03):
  • [49] Connection between MP and DPP for Stochastic Recursive Optimal Control Problems: Viscosity Solution Framework in Local Case
    Nie, Tianyang
    Shi, Jingtao
    Wu, Zhen
    2016 AMERICAN CONTROL CONFERENCE (ACC), 2016, : 7225 - 7230
  • [50] WEAK CONVERGENCE OF MCKEAN-VLASOV STOCHASTIC DIFFERENTIAL EQUATIONS WITH TWO-TIME-SCALE MARKOV SWITCHING
    Cao, Wenjie
    Wu, Fuke
    NUMERICAL ALGEBRA CONTROL AND OPTIMIZATION, 2024, 14 (04): : 688 - 705