A COMPUTATIONAL METHOD FOR STOCHASTIC OPTIMAL CONTROL PROBLEMS IN FINANCIAL MATHEMATICS

被引:8
|
作者
Kafash, Behzad [1 ,2 ]
Delavarkhalafi, Ali [2 ]
Karbassi, Seyed Mehdi [3 ]
机构
[1] Ardakan Univ, Dept Engn, Ardakan, Iran
[2] Yazd Univ, Fac Math, Yazd, Iran
[3] Islamic Azad Univ, Dept Math, Yazd Branch, Yazd, Iran
关键词
Stochastic optimal control problem; Hamilton-Jacobi-Bellman (HJB) equation; variational iteration method (VIM); Banach's fixed point theorem; Merton's portfolio selection model; NUMERICAL-METHODS; SYSTEMS;
D O I
10.1002/asjc.1242
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Principle of optimality or dynamic programming leads to derivation of a partial differential equation (PDE) for solving optimal control problems, namely the Hamilton-Jacobi-Bellman (HJB) equation. In general, this equation cannot be solved analytically; thus many computing strategies have been developed for optimal control problems. Many problems in financial mathematics involve the solution of stochastic optimal control (SOC) problems. In this work, the variational iteration method (VIM) is applied for solving SOC problems. In fact, solutions for the value function and the corresponding optimal strategies are obtained numerically. We solve a stochastic linear regulator problem to investigate the applicability and simplicity of the presented method and prove its convergence. In particular, for Merton's portfolio selection model as a problem of portfolio optimization, the proposed numerical method is applied for the first time and its usefulness is demonstrated. For the nonlinear case, we investigate its convergence using Banach's fixed point theorem. The numerical results confirm the simplicity and efficiency of our method.
引用
收藏
页码:1501 / 1512
页数:12
相关论文
共 50 条
  • [21] A new computational approach for optimal control problems with multiple time-delay
    Wu, Di
    Bai, Yanqin
    Yu, Changjun
    AUTOMATICA, 2019, 101 : 388 - 395
  • [22] A NEW GRADIENT COMPUTATIONAL FORMULA FOR OPTIMAL CONTROL PROBLEMS WITH TIME-DELAY
    Yu, Changjun
    Yuan, Lei
    Su, Shuxuan
    JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2022, 18 (04) : 2469 - 2482
  • [23] Stochastic maximum principle for optimal control problems with mixed delays and noisy observations
    Ma, Heping
    Shi, Yu
    EUROPEAN JOURNAL OF CONTROL, 2024, 79
  • [24] Asymptotic regularization methods in singularly perturbed stochastic optimal-control problems
    Salikhov Z.G.
    Ishmet'ev E.N.
    Rutkovskii A.L.
    Alekhin V.I.
    Salikhov M.Z.
    Steel Transl., 2008, 1 (17-19): : 17 - 19
  • [25] The Maximum Principles for Stochastic Recursive Optimal Control Problems Under Partial Information
    Wang, Guangchen
    Wu, Zhen
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2009, 54 (06) : 1230 - 1242
  • [26] Linear Quadratic Optimal Control Problems of Delayed Backward Stochastic Differential Equations
    Meng, Weijun
    Shi, Jingtao
    APPLIED MATHEMATICS AND OPTIMIZATION, 2021, 84 (SUPPL 1) : S523 - S559
  • [27] SECOND ORDER NECESSARY CONDITIONS FOR OPTIMAL CONTROL PROBLEMS OF STOCHASTIC EVOLUTION EQUATIONS
    Lu, Qi
    Zhang, Haisen
    Zhang, Xu
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2021, 59 (04) : 2924 - 2954
  • [28] Stochastic Linear Quadratic Optimal Control Problem: A Reinforcement Learning Method
    Li, Na
    Li, Xun
    Peng, Jing
    Xu, Zuo Quan
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2022, 67 (09) : 5009 - 5016
  • [29] Solving Stochastic Optimal Control Problem via Stochastic Maximum Principle with Deep Learning Method
    Ji, Shaolin
    Peng, Shige
    Peng, Ying
    Zhang, Xichuan
    JOURNAL OF SCIENTIFIC COMPUTING, 2022, 93 (01)
  • [30] Fractional Chebyshev pseudospectral method for fractional optimal control problems
    Habibli, M.
    Skandari, M. H. Noori
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2019, 40 (03) : 558 - 572