Stochastic recursive optimal control of McKean-Vlasov type: A viscosity solution approach

被引:0
|
作者
Zhang, Liangquan [1 ]
机构
[1] Renmin Univ China, Sch Math, Beijing 100872, Peoples R China
关键词
Dynamic programming principle; Forward-backward McKean-Vlasov stochastic differential equations; Hamilton-Jacobi-Bellman equation; Wasserstein space; Value function; Viscosity solutions; MEAN-FIELD GAMES; DIFFERENTIAL-EQUATIONS; MAXIMUM PRINCIPLE; BACKWARD SDES; SYSTEMS; RISK; AMBIGUITY;
D O I
10.1016/j.jde.2024.07.015
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
In this paper, we study a kind of optimal control problem for forward-backward stochastic differential equations (FBSDEs for short) of McKean-Vlasov type via the dynamic programming principle (DPP for short) motivated by studying the infinite dimensional Hamilton-Jacobi-Bellman (HJB for short) equation derived from the decoupling field of the FBSDEs posed by Carmona and Delarue (2015) [28]. At the beginning, the value function is defined by the solution to the controlled BSDE alluded to earlier. On one hand, we can prove the value function is deterministic function with respect to the initial random variable; On the other hand, we can show that the value function is law-invariant, i.e., depending on only via its distribution by virtue of BSDE property. Afterward, utilizing the notion of differentiability with respect to probability measures introduced by P.L. Lions [50], we are able to establish a DPP for the value function in the Wasserstein space of probability measures based on the application of BSDE approach, particularly, employing the notion of stochastic backward semigroups associated with stochastic optimal control problems and It & ocirc; formula along a flow property of the conditional law of the controlled forward state process. We prove that the value function is the unique viscosity solutions of the associated generalized HJB equations in some separable Hilbert space. Finally, as an application, we formulate an optimal control problem for linear stochastic differential equations with quadratic cost functionals of McKean-Vlasov type under nonlinear expectation, g-expectation introduced by Peng [43] and derive the optimal feedback control explicitly by means of several groups of Riccati equations. (c) 2024 Elsevier Inc. All rights are reserved, including those for text and data mining, AI training, and similar technologies.
引用
收藏
页码:334 / 394
页数:61
相关论文
共 50 条
  • [1] DYNAMIC PROGRAMMING FOR OPTIMAL CONTROL OF STOCHASTIC MCKEAN-VLASOV DYNAMICS
    Pham, Huyen
    Wei, Xiaoli
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2017, 55 (02) : 1069 - 1101
  • [2] On optimal solutions of general continuous-singular stochastic control problem of McKean-Vlasov type
    Guenane, Lina
    Hafayed, Mokhtar
    Meherrem, Shahlar
    Abbas, Syed
    MATHEMATICAL METHODS IN THE APPLIED SCIENCES, 2020, 43 (10) : 6498 - 6516
  • [3] VISCOSITY SOLUTIONS FOR MCKEAN-VLASOV CONTROL ON A TORUS
    Soner, H. Mete
    Yan, Qinxin
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2024, 62 (02) : 903 - 923
  • [4] Stochastic optimal control of McKean-Vlasov equations with anticipating law
    Agram, Nacira
    AFRIKA MATEMATIKA, 2019, 30 (5-6) : 879 - 901
  • [5] Extended Mckean-Vlasov optimal stochastic control applied to smart grid management*, **
    Gobet, Emmanuel
    Grangereau, Maxime
    ESAIM-CONTROL OPTIMISATION AND CALCULUS OF VARIATIONS, 2022, 28
  • [6] MCKEAN-VLASOV OPTIMAL CONTROL: THE DYNAMIC PROGRAMMING PRINCIPLE
    Djete, Mao Fabrice
    Possamai, Dylan
    Tan, Xiaolu
    ANNALS OF PROBABILITY, 2022, 50 (02): : 791 - 833
  • [7] VISCOSITY SOLUTIONS FOR CONTROLLED MCKEAN-VLASOV JUMP-DIFFUSIONS
    Burzoni, Matteo
    Ignazio, Vincenzo
    Reppen, A. Max
    Soner, H. M.
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2020, 58 (03) : 1676 - 1699
  • [8] On partially observed optimal singular control of McKean-Vlasov stochastic systems: Maximum principle approach
    Abada, Nour El Houda
    Hafayed, Mokhtar
    Meherrem, Shahlar
    MATHEMATICAL METHODS IN THE APPLIED SCIENCES, 2022, 45 (16) : 10363 - 10383
  • [9] OPTIMAL CONTROL OF MCKEAN-VLASOV EQUATIONS WITH CONTROLLED STOCHASTICITY
    DI Persio, Luca
    Kuchling, Peter
    EVOLUTION EQUATIONS AND CONTROL THEORY, 2025, 14 (02): : 367 - 387
  • [10] NONLINEAR FILTERING THEORY FOR MCKEAN-VLASOV TYPE STOCHASTIC DIFFERENTIAL EQUATIONS
    Sen, Nevroz
    Caines, Peter E.
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2016, 54 (01) : 153 - 174