Convergence of the deep BSDE method for stochastic control problems formulated through the stochastic maximum principle

被引:0
|
作者
Huang, Zhipeng [1 ]
Negyesi, Balint [2 ]
Oosterlee, Cornelis W. [1 ]
机构
[1] Univ Utrecht, Math Inst, Utrecht, Netherlands
[2] Delft Univ Technol, Delft Inst Appl Math DIAM, Delft, Netherlands
关键词
Stochastic control; Deep SMP-BSDE; Stochastic maximum principle; Vector-valued FBSDE; FINITE-DIFFERENCE APPROXIMATIONS; BELLMAN EQUATIONS; NEURAL-NETWORKS; SCHEMES;
D O I
10.1016/j.matcom.2024.08.002
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
It is well-known that decision-making problems from stochastic control can be formulated by means of a forward-backward stochastic differential equation (FBSDE). Recently, the authors of Ji et al. (2022) proposed an efficient deep learning algorithm based on the stochastic maximum principle (SMP). In this paper, we provide a convergence result for this deep SMP-BSDE algorithm and compare its performance with other existing methods. In particular, by adopting a strategy as in Han and Long (2020), we derive a-posteriori estimate, , and show that the total approximation error can be bounded by the value of the loss functional and the discretization error. We present numerical examples for high-dimensional stochastic control problems, both in the cases of drift- and diffusion control, which showcase superior performance compared to existing algorithms.
引用
收藏
页码:553 / 568
页数:16
相关论文
共 50 条
  • [1] Maximum principle for singular stochastic control problems
    Dufour, F.
    Miller, B.
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2006, 45 (02) : 668 - 698
  • [2] Solving Stochastic Optimal Control Problem via Stochastic Maximum Principle with Deep Learning Method
    Ji, Shaolin
    Peng, Shige
    Peng, Ying
    Zhang, Xichuan
    JOURNAL OF SCIENTIFIC COMPUTING, 2022, 93 (01)
  • [3] Solving Stochastic Optimal Control Problem via Stochastic Maximum Principle with Deep Learning Method
    Shaolin Ji
    Shige Peng
    Ying Peng
    Xichuan Zhang
    Journal of Scientific Computing, 2022, 93
  • [4] A general stochastic maximum principle for singular control problems
    Bahlali, S
    Mezerdi, B
    ELECTRONIC JOURNAL OF PROBABILITY, 2005, 10 : 988 - 1004
  • [5] A Stochastic Maximum Principle for Control Problems Constrained by the Stochastic Navier–Stokes Equations
    Peter Benner
    Christoph Trautwein
    Applied Mathematics & Optimization, 2021, 84 : 1001 - 1054
  • [6] A Stochastic Maximum Principle for Control Problems Constrained by the Stochastic Navier-Stokes Equations
    Benner, Peter
    Trautwein, Christoph
    APPLIED MATHEMATICS AND OPTIMIZATION, 2021, 84 (SUPPL 1): : S1001 - S1054
  • [7] A General Maximum Principle for Delayed Stochastic Optimal Control Problems
    Zhang, Qixia
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 1839 - 1845
  • [8] A GENERAL STOCHASTIC MAXIMUM PRINCIPLE FOR OPTIMAL-CONTROL PROBLEMS
    PENG, SG
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1990, 28 (04) : 966 - 979
  • [9] THE GENERAL MAXIMUM PRINCIPLE FOR STOCHASTIC CONTROL PROBLEMS WITH SINGULAR CONTROLS
    Song, Y. U. A. N. Z. H. U. O.
    Wu, Z. H. E. N.
    DISCRETE AND CONTINUOUS DYNAMICAL SYSTEMS, 2022, 42 (11) : 1 - 15
  • [10] On the maximum principle for relaxed control problems of nonlinear stochastic systems
    Meriem Mezerdi
    Brahim Mezerdi
    Advances in Continuous and Discrete Models, 2024