State, global, and local parameter estimation using local ensemble Kalman filters: Applications to online machine learning of chaotic dynamics

被引:13
|
作者
Malartic, Q. [1 ,2 ]
Farchi, A. [1 ]
Bocquet, M. [1 ]
机构
[1] Ecole Ponts & EDF R&D, CEREA, F-77420 Ile De France, France
[2] Sorbonne Univ, CNRS, Inst Polytech Paris, Ecole Polytech,LMD IPSL,ENS,PSL Univ, Paris, France
关键词
chaotic dynamics; data-driven dynamics; LEnSRF; LETKF; local ensemble Kalman filters; machine learning; parameter estimation; DATA ASSIMILATION; WEATHER;
D O I
10.1002/qj.4297
中图分类号
P4 [大气科学(气象学)];
学科分类号
0706 ; 070601 ;
摘要
In a recent methodological article, we showed how to learn chaotic dynamics along with the state trajectory from sequentially acquired observations, using local ensemble Kalman filters. Here, we investigate more systematically the possibility of using a local ensemble Kalman filter with either covariance localisation or local domains, in order to retrieve the state and a mix of key global and local parameters. Global parameters are meant to represent the surrogate dynamical core, for instance through a neural network, which is reminiscent of data-driven machine learning of dynamics, while the local parameters typically stand for the forcings of the model. Aiming at joint state and parameter estimation, a family of algorithms for covariance and local domain localisation is proposed. In particular, we show how to update global parameters rigorously using a local-domain ensemble Kalman filter (EnKF) such as the local ensemble transform Kalman filter (LETKF), an inherently local method. The approach is tested with success on the 40-variable Lorenz model using several of the local EnKF flavors. A two-dimensional illustration based on a multilayer Lorenz model is finally provided. It uses radiance-like nonlocal observations. It features both local domains and covariance localisation, in order to learn the chaotic dynamics and the local forcings. This article addresses more generally the key question of online estimation of both global and local model parameters.
引用
收藏
页码:2167 / 2193
页数:27
相关论文
共 50 条
  • [31] Deep Learning-based Vehicle Classification using an Ensemble of Local Expert and Global Networks
    Lee, Jong Taek
    Chung, Yunsu
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 920 - 925
  • [32] From global to local Bayesian parameter estimation in image restoration using variational distribution approximations
    Molina, Rafael
    Vega, Miguel
    Katsaggelos, Aggelos K.
    2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, : 121 - +
  • [33] Estimation of peripheral artery radius using non-invasive sensors and Kalman filtering of local dynamics
    Wang, Lu
    Ansari, Sardar
    Najarian, Kayvan
    Ward, Kevin R.
    Oldham, Kenn R.
    2017 AMERICAN CONTROL CONFERENCE (ACC), 2017, : 807 - 812
  • [34] Estimation of Local Failure in Large Tensegrity Structures via Substructuring Using Interacting Particle-Ensemble Kalman Filter
    Aswal, Neha
    Sen, Subhamoy
    Mevel, Laurent
    EUROPEAN WORKSHOP ON STRUCTURAL HEALTH MONITORING (EWSHM 2022), VOL 3, 2023, : 943 - 951
  • [35] Parameter estimation and uncertainty quantification of rainfall-runoff models using data assimilation methods based on deep learning and local ensemble updates
    Yao, Lei
    Zhang, Jiangjiang
    Cao, Chenglong
    Zheng, Feifei
    ENVIRONMENTAL MODELLING & SOFTWARE, 2025, 185
  • [36] A multi-scale parameter adaptive method for state of charge and parameter estimation of lithium-ion batteries using dual Kalman filters
    Guo, Feng
    Hu, Guangdi
    Xiang, Shun
    Zhou, Pengkai
    Hong, Ru
    Xiong, Neng
    ENERGY, 2019, 178 : 79 - 88
  • [37] An Adaptive Ensemble Approach Using Online Global and Local Models for Pump Pressure Prediction in Well Cementing Operations
    Zhong, Yuan
    Yang, Jianxin
    Xian, Ming
    Zhou, Jing
    Li, Ping
    SPE JOURNAL, 2025, 30 (02): : 471 - 485
  • [38] An improved DFA based kernel ensemble learning machine using local feature representations for face recognition
    Kavitha, N.
    Soundar, K. Ruba
    Kumar, T. Sathis
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2021, 41 (01) : 1203 - 1216
  • [39] Short-term forecast and dual state-parameter estimation for Japanese Encephalitis transmission using ensemble Kalman filter
    Riad, Mahbubul H.
    Scoglio, Caterina M.
    Cohnstaedt, Lee W.
    McVey, D. Scott
    2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 3444 - 3449
  • [40] Dual state-parameter optimal estimation of one-dimensional open channel model using ensemble Kalman filter
    Lai Rui-xun
    Fang Hong-wei
    He Guo-jian
    Yu Xin
    Yang Ming
    Wang Ming
    JOURNAL OF HYDRODYNAMICS, 2013, 25 (04) : 564 - 571