RECENT DEVELOPMENTS IN MACHINE LEARNING METHODS FOR STOCHASTIC CONTROL AND GAMES

被引:0
|
作者
Hu, Ruimeng [1 ,2 ]
Lauriere, Mathieu [3 ]
机构
[1] Univ Calif Santa Barbara, Dept Math, Santa Barbara, CA 93106 USA
[2] Univ Calif Santa Barbara, Dept Stat & Appl Probabil, Santa Barbara, CA 93106 USA
[3] NYU Shanghai, Shanghai Frontiers Sci Ctr Artificial Intelligence, NYU ECNU Inst Math Sci, 567 West Yangsi Rd, Shanghai 200126, Peoples R China
来源
关键词
Stochastic optimal control; stochastic games; mean field games; ma- chine learning; deep learning; MEAN-FIELD GAMES; PARTIAL-DIFFERENTIAL-EQUATIONS; MULTILAYER FEEDFORWARD NETWORKS; DISCRETE-TIME APPROXIMATION; MARKOV DECISION-PROCESSES; SEMI-LAGRANGIAN SCHEME; DEEP NEURAL-NETWORKS; NUMERICAL-METHODS; FICTITIOUS PLAY; POLICY GRADIENT;
D O I
10.3934/naco.2024031
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
. Stochastic optimal control and games have a wide range of applications, from finance and economics to social sciences, robotics, and energy management. Many real-world applications involve complex models that have driven the development of sophisticated numerical methods. Recently, computational methods based on machine learning have been developed for solving stochastic control problems and games. In this review, we focus on deep learning methods that have unlocked the possibility of solving such problems, even in high dimensions or when the structure is very complex, beyond what traditional numerical methods can achieve. We consider mostly the continuous time and continuous space setting. Many of the new approaches build on recent neural-network-based methods for solving high-dimensional partial differential equations or backward stochastic differential equations, or on model-free reinforcement learning for Markov decision processes that have led to breakthrough results. This paper provides an introduction to these methods and summarizes the state-of-the-art works at the crossroad of machine learning and stochastic control and games.
引用
收藏
页码:435 / 525
页数:91
相关论文
共 50 条
  • [41] RECENT DEVELOPMENTS IN STOCHASTIC ACTIVITY NETWORKS
    NEUMANN, K
    INFOR, 1984, 22 (03) : 219 - 248
  • [42] The application of stochastic machine learning methods in the prediction of skin penetration
    Sun, Y.
    Brown, M. B.
    Prapopoulou, M.
    Davey, N.
    Adams, R. G.
    Moss, G. P.
    APPLIED SOFT COMPUTING, 2011, 11 (02) : 2367 - 2375
  • [43] ON THE USE OF STOCHASTIC HESSIAN INFORMATION IN OPTIMIZATION METHODS FOR MACHINE LEARNING
    Byrd, Richard H.
    Chin, Gillian M.
    Neveitt, Will
    Nocedal, Jorge
    SIAM JOURNAL ON OPTIMIZATION, 2011, 21 (03) : 977 - 995
  • [44] RECENT TRENDS IN STOCHASTIC GRADIENT DESCENT FOR MACHINE LEARNING AND BIG DATA
    Newton, David
    Pasupathy, Raghu
    Yousefian, Farzad
    2018 WINTER SIMULATION CONFERENCE (WSC), 2018, : 366 - 380
  • [45] Machine learning control - explainable and analyzable methods
    Quade, Markus
    Isele, Thomas
    Abel, Markus
    PHYSICA D-NONLINEAR PHENOMENA, 2020, 412
  • [46] Developments of control system for ion source using machine learning
    Morita, Y.
    Fukuda, M.
    Yorita, T.
    Kanda, H.
    Hatanaka, K.
    Saitou, T.
    Tamura, H.
    Yasuda, Y.
    Washio, T.
    Nakashima, Y.
    Iwasaki, M.
    Koay, H. W.
    Takeda, K.
    Hara, T.
    Chong, T. H.
    Zhao, H.
    19TH INTERNATIONAL CONFERENCE ON ION SOURCES - ICIS2021, 2022, 2244
  • [47] Admission Control Using Stochastic Learning Games in Cognitive Radio Networks
    Raiss-El-Fenni, Mohammed
    El Kamili, Mohamed
    INTERNATIONAL JOURNAL OF FUTURE GENERATION COMMUNICATION AND NETWORKING, 2014, 7 (01): : 29 - 42
  • [48] Recent developments in computational methods
    Park, Young Ho
    Tang, Jun
    Proceedings of the ASME Pressure Vessels and Piping Conference 2005, Vol 2, 2005, 2 : 383 - 383
  • [49] RECENT DEVELOPMENTS IN IMMUNOENZYMATIC METHODS
    AVRAMEAS, S
    FRESENIUS ZEITSCHRIFT FUR ANALYTISCHE CHEMIE, 1984, 317 (06): : 647 - 648
  • [50] RECENT DEVELOPMENTS IN SEPARATION METHODS
    THOMSON, AR
    PROCESS BIOCHEMISTRY, 1971, 6 (09) : 35 - +