Discrete-Time Mean-Field Stochastic Control with Partial Observations

被引:0
|
作者
Chichportich J. [1 ,2 ]
Kharroubi I. [1 ]
机构
[1] LPSM, UMR CNRS 8001, Sorbonne University and Université Paris Cité, Paris
[2] Bramham Gardens, Paris
来源
Applied Mathematics and Optimization | 2023年 / 88卷 / 03期
关键词
Dynamic programming; Mean-field interaction; Optimal control; Partial observation;
D O I
10.1007/s00245-023-10068-4
中图分类号
学科分类号
摘要
We study the optimal control of discrete time mean filed dynamical systems under partial observations. We express the global law of the filtered process as a controlled system with its own dynamics. Following a dynamic programming approach, we prove a verification result providing a solution to the optimal control of the filtered system. As an application, we consider a general linear quadratic example for which an explicit solution is given. We also describe an algorithm for the numerical approximation of the optimal value and provide numerical experiments on a financial example. © 2023, The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.
引用
收藏
相关论文
共 50 条
  • [31] Refined mean-field approximation for discrete-time queueing networks with blocking
    Pan, Yang
    Shi, Pengyi
    NAVAL RESEARCH LOGISTICS, 2023, 70 (07) : 770 - 789
  • [32] Learning in Discrete-time Average-cost Mean-field Games
    Anahtarci, Berkay
    Kariksiz, Can Deha
    Saldi, Naci
    2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 3048 - 3053
  • [33] Linear-Quadratic Optimal Control for Discrete-Time Mean-Field Systems With Input Delay
    Qi, Qingyuan
    Xie, Lihua
    Zhang, Huanshui
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2022, 67 (08) : 3806 - 3821
  • [34] Optimal control for unknown mean-field discrete-time system based on Q-Learning
    Ge, Yingying
    Liu, Xikui
    Li, Yan
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2021, 52 (15) : 3335 - 3349
  • [35] Mean-Field Limits for Discrete-Time Dynamical Systems via Kernel Mean Embeddings
    Fiedler, Christian
    Herty, Michael
    Trimpe, Sebastian
    IEEE CONTROL SYSTEMS LETTERS, 2023, 7 : 3914 - 3919
  • [36] Discrete-Time Mean Field Control with Environment States
    Cui, Kai
    Tahir, Anam
    Sinzger, Mark
    Koeppl, Heinz
    2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 5239 - 5246
  • [37] Event-triggered annular finite-time H∞ filtering for discrete-time mean-field stochastic systems
    Zhuang, Jijing
    Liu, Xikui
    Li, Yan
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2024, 34 (02) : 1148 - 1168
  • [38] Linear-quadratic optimal control for unknown mean-field stochastic discrete-time system via adaptive dynamic programming approach
    Liu, Ruirui
    Li, Yan
    Liu, Xikui
    NEUROCOMPUTING, 2018, 282 : 16 - 24
  • [39] DISCRETE-TIME APPROXIMATION OF STOCHASTIC OPTIMAL CONTROL WITH PARTIAL OBSERVATION
    Li, Yunzhang
    Tan, Xiaolu
    Tang, Shanjian
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2024, 62 (01) : 326 - 350
  • [40] Stabilisation by stochastic feedback control based on discrete-time observations
    Wei, Chao
    IAENG International Journal of Applied Mathematics, 2019, 49 (04): : 1 - 7