Stochastic recursive optimal control of McKean-Vlasov type: A viscosity solution approach

被引:0
|
作者
Zhang, Liangquan [1 ]
机构
[1] Renmin Univ China, Sch Math, Beijing 100872, Peoples R China
关键词
Dynamic programming principle; Forward-backward McKean-Vlasov stochastic differential equations; Hamilton-Jacobi-Bellman equation; Wasserstein space; Value function; Viscosity solutions; MEAN-FIELD GAMES; DIFFERENTIAL-EQUATIONS; MAXIMUM PRINCIPLE; BACKWARD SDES; SYSTEMS; RISK; AMBIGUITY;
D O I
10.1016/j.jde.2024.07.015
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
In this paper, we study a kind of optimal control problem for forward-backward stochastic differential equations (FBSDEs for short) of McKean-Vlasov type via the dynamic programming principle (DPP for short) motivated by studying the infinite dimensional Hamilton-Jacobi-Bellman (HJB for short) equation derived from the decoupling field of the FBSDEs posed by Carmona and Delarue (2015) [28]. At the beginning, the value function is defined by the solution to the controlled BSDE alluded to earlier. On one hand, we can prove the value function is deterministic function with respect to the initial random variable; On the other hand, we can show that the value function is law-invariant, i.e., depending on only via its distribution by virtue of BSDE property. Afterward, utilizing the notion of differentiability with respect to probability measures introduced by P.L. Lions [50], we are able to establish a DPP for the value function in the Wasserstein space of probability measures based on the application of BSDE approach, particularly, employing the notion of stochastic backward semigroups associated with stochastic optimal control problems and It & ocirc; formula along a flow property of the conditional law of the controlled forward state process. We prove that the value function is the unique viscosity solutions of the associated generalized HJB equations in some separable Hilbert space. Finally, as an application, we formulate an optimal control problem for linear stochastic differential equations with quadratic cost functionals of McKean-Vlasov type under nonlinear expectation, g-expectation introduced by Peng [43] and derive the optimal feedback control explicitly by means of several groups of Riccati equations. (c) 2024 Elsevier Inc. All rights are reserved, including those for text and data mining, AI training, and similar technologies.
引用
收藏
页码:334 / 394
页数:61
相关论文
共 50 条
  • [21] Near-Optimal Control of Stochastic Recursive Systems Via Viscosity Solution
    Zhang, Liangquan
    Zhou, Qing
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2018, 178 (02) : 363 - 382
  • [22] A McKean-Vlasov optimal mixed regular-singular control problem for nonlinear stochastic systems with Poisson jump processes
    Hafayed, Mokhtar
    Boukaf, Samira
    Shi, Yan
    Meherrem, Shahlar
    NEUROCOMPUTING, 2016, 182 : 133 - 144
  • [23] OPTIMAL CONTROL OF PATH-DEPENDENT MCKEAN-VLASOV SDES IN INFINITE-DIMENSION
    Cosso, Andrea
    Gozzi, Fausto
    Kharroubi, Idris
    Pham, Huyen
    Rosestolato, Mauro
    ANNALS OF APPLIED PROBABILITY, 2023, 33 (04): : 2863 - 2918
  • [24] Optimal stopping of conditional McKean-Vlasov jump diffusions
    Agram, Nacira
    Oksendal, Bernt
    SYSTEMS & CONTROL LETTERS, 2024, 188
  • [25] Zero-sum stochastic differential games of generalized McKean-Vlasov type
    Cosso, Andrea
    Pham, Huyen
    JOURNAL DE MATHEMATIQUES PURES ET APPLIQUEES, 2019, 129 : 180 - 212
  • [26] Ergodic control of McKean-Vlasov SDEs and associated Bellman equation
    Bao, Xiaofan
    Tang, Shanjian
    JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2023, 527 (01)
  • [27] Discrete Time McKean-Vlasov Control Problem: A Dynamic Programming Approach
    Huyn Pham
    Wei, Xiaoli
    APPLIED MATHEMATICS AND OPTIMIZATION, 2016, 74 (03): : 487 - 506
  • [28] VISCOSITY SOLUTIONS TO PARABOLIC MASTER EQUATIONS AND MCKEAN-VLASOV SDES WITH CLOSED-LOOP CONTROLS
    Wu, Cong
    Zhang, Jianfeng
    ANNALS OF APPLIED PROBABILITY, 2020, 30 (02): : 936 - 986
  • [29] Impulse Control of Conditional McKean-Vlasov Jump Diffusions
    Agram, Nacira
    Pucci, Giulia
    Oksendal, Bernt
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2024, 200 (03) : 1100 - 1130
  • [30] Stochastic recursive optimal control problem with mixed delay under viscosity solution's framework
    Meng, Weijun
    Shi, Jingtao
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2021, 42 (02): : 445 - 468