RECENT DEVELOPMENTS IN MACHINE LEARNING METHODS FOR STOCHASTIC CONTROL AND GAMES

被引:0
|
作者
Hu, Ruimeng [1 ,2 ]
Lauriere, Mathieu [3 ]
机构
[1] Univ Calif Santa Barbara, Dept Math, Santa Barbara, CA 93106 USA
[2] Univ Calif Santa Barbara, Dept Stat & Appl Probabil, Santa Barbara, CA 93106 USA
[3] NYU Shanghai, Shanghai Frontiers Sci Ctr Artificial Intelligence, NYU ECNU Inst Math Sci, 567 West Yangsi Rd, Shanghai 200126, Peoples R China
来源
关键词
Stochastic optimal control; stochastic games; mean field games; ma- chine learning; deep learning; MEAN-FIELD GAMES; PARTIAL-DIFFERENTIAL-EQUATIONS; MULTILAYER FEEDFORWARD NETWORKS; DISCRETE-TIME APPROXIMATION; MARKOV DECISION-PROCESSES; SEMI-LAGRANGIAN SCHEME; DEEP NEURAL-NETWORKS; NUMERICAL-METHODS; FICTITIOUS PLAY; POLICY GRADIENT;
D O I
10.3934/naco.2024031
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
. Stochastic optimal control and games have a wide range of applications, from finance and economics to social sciences, robotics, and energy management. Many real-world applications involve complex models that have driven the development of sophisticated numerical methods. Recently, computational methods based on machine learning have been developed for solving stochastic control problems and games. In this review, we focus on deep learning methods that have unlocked the possibility of solving such problems, even in high dimensions or when the structure is very complex, beyond what traditional numerical methods can achieve. We consider mostly the continuous time and continuous space setting. Many of the new approaches build on recent neural-network-based methods for solving high-dimensional partial differential equations or backward stochastic differential equations, or on model-free reinforcement learning for Markov decision processes that have led to breakthrough results. This paper provides an introduction to these methods and summarizes the state-of-the-art works at the crossroad of machine learning and stochastic control and games.
引用
收藏
页码:435 / 525
页数:91
相关论文
共 50 条
  • [32] Machine learning and games
    Michael Bowling
    Johannes Fürnkranz
    Thore Graepel
    Ron Musick
    Machine Learning, 2006, 63 : 211 - 215
  • [33] A Concise Review on Recent Developments of Machine Learning for the Prediction of Vibrational Spectra
    Han, Ruocheng
    Ketkaew, Rangsiman
    Luber, Sandra
    JOURNAL OF PHYSICAL CHEMISTRY A, 2022, 126 (06): : 801 - 812
  • [34] Automation in Agriculture by Machine and Deep Learning Techniques: A Review of Recent Developments
    Muhammad Hammad Saleem
    Johan Potgieter
    Khalid Mahmood Arif
    Precision Agriculture, 2021, 22 : 2053 - 2091
  • [35] Machine learning for financial forecasting, planning and analysis: recent developments and pitfalls
    Helmut Wasserbacher
    Martin Spindler
    Digital Finance, 2022, 4 (1): : 63 - 88
  • [36] CONTROL OF IRRADIATED FOOD - RECENT DEVELOPMENTS IN ANALYTICAL DETECTION METHODS
    DELINCEE, H
    RADIATION PHYSICS AND CHEMISTRY, 1993, 42 (1-3): : 351 - 357
  • [37] RECENT DEVELOPMENTS IN MACHINE MILKING
    BUTLER, C
    OUTLOOK ON AGRICULTURE, 1988, 17 (04) : 153 - 157
  • [38] A review on recent developments in cancer detection using Machine Learning and Deep Learning models
    Maurya, Sonam
    Tiwari, Sushil
    Mothukuri, Monika Chowdary
    Tangeda, Chandra Mallika
    Nandigam, Rohitha Naga Sri
    Addagiri, Durga Chandana
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 80
  • [39] Adaptive stochastic resource control:: A machine learning approach
    Csaji, Balazs Csanad
    Monostori, Laszlo
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2008, 32 (453-486): : 453 - 486
  • [40] Recent developments in linear stochastic electrodynamics
    de la Peña, L
    Cetto, AM
    QUANTUM THEORY: RECONSIDERATION OF FOUNDATIONS - 3, 2006, 810 : 131 - +