Deep Learning Methods for Mean Field Control Problems With Delay

被引:30
|
作者
Fouque, Jean-Pierre [1 ]
Zhang, Zhaoyu [1 ]
机构
[1] Univ Calif Santa Barbara, Dept Stat & Appl Probabil, Santa Barbara, CA 93106 USA
关键词
deep learning; mean field control; delay; McKean-Vlasov; stochastic maximum principal; STOCHASTIC DIFFERENTIAL-EQUATIONS; GAMES;
D O I
10.3389/fams.2020.00011
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
We consider a general class of mean field control problems described by stochastic delayed differential equations of McKean-Vlasov type. Two numerical algorithms are provided based on deep learning techniques, one is to directly parameterize the optimal control using neural networks, the other is based on numerically solving the McKean-Vlasov forward anticipated backward stochastic differential equation (MV-FABSDE) system. In addition, we establish the necessary and sufficient stochastic maximum principle of this class of mean field control problems with delay based on the differential calculus on function of measures, and the existence and uniqueness results are proved for the associated MV-FABSDE system under suitable conditions. Mathematical Subject Classification (2000): 93E20, 60G99, 68-04
引用
收藏
页数:17
相关论文
共 50 条
  • [1] DEEP LEARNING AS OPTIMAL CONTROL PROBLEMS: MODELS AND NUMERICAL METHODS
    Benning, Martin
    Celledoni, Elena
    Ehrhardt, Matthias J.
    Owren, Brynjulf
    Schonlieb, Carola-Bibiane
    JOURNAL OF COMPUTATIONAL DYNAMICS, 2019, 6 (02): : 171 - 198
  • [2] Mean Field Deep Reinforcement Learning for Fair and Efficient UAV Control
    Chen, Dezhi
    Qi, Qi
    Zhuang, Zirui
    Wang, Jingyu
    Liao, Jianxin
    Han, Zhu
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (02) : 813 - 828
  • [3] Fourier Galerkin approximation of mean field control problems
    Delarue, Francois
    Martini, Mattia
    NODEA-NONLINEAR DIFFERENTIAL EQUATIONS AND APPLICATIONS, 2025, 32 (01):
  • [4] A machine learning framework for solving high-dimensional mean field game and mean field control problems
    Ruthotto, Lars
    Osher, Stanley J.
    Li, Wuchen
    Nurbekyan, Levon
    Fung, Samy Wu
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2020, 117 (17) : 9183 - 9193
  • [5] Continuous Time q-Learning for Mean-Field Control Problems
    Wei, Xiaoli
    Yu, Xiang
    APPLIED MATHEMATICS AND OPTIMIZATION, 2025, 91 (01)
  • [6] Unified reinforcement Q-learning for mean field game and control problems
    Andrea Angiuli
    Jean-Pierre Fouque
    Mathieu Laurière
    Mathematics of Control, Signals, and Systems, 2022, 34 : 217 - 271
  • [7] Deep Learning and Mean-Field Games: A Stochastic Optimal Control Perspective
    Di Persio, Luca
    Garbelli, Matteo
    SYMMETRY-BASEL, 2021, 13 (01): : 1 - 20
  • [8] Unified reinforcement Q-learning for mean field game and control problems
    Angiuli, Andrea
    Fouque, Jean-Pierre
    Lauriere, Mathieu
    MATHEMATICS OF CONTROL SIGNALS AND SYSTEMS, 2022, 34 (02) : 217 - 271
  • [9] CONTROL ON HILBERT SPACES AND APPLICATION TO SOME MEAN FIELD TYPE CONTROL PROBLEMS
    Bensoussan, Alain
    Graber, P. Jameson
    Yam, Sheung Chi Phillip
    ANNALS OF APPLIED PROBABILITY, 2024, 34 (04) : 4085 - 4136
  • [10] MEAN-FIELD LIMIT FOR A CLASS OF STOCHASTIC ERGODIC CONTROL PROBLEMS
    Albeverio, Sergio
    de Vecchi, Francesco C.
    Romano, Andrea
    Ugolini, Stefania
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2022, 60 (01) : 479 - 504