Combining a Fully Connected Neural Network With an Ensemble Kalman Filter to Emulate a Dynamic Model in Data Assimilation

被引:8
作者
Fan, Manhong [1 ]
Bai, Yulong [1 ]
Wang, Lili [1 ]
Ding, Lin [1 ]
机构
[1] Northwest Normal Univ, Coll Phys & Elect Engn, Lanzhou 730070, Peoples R China
基金
中国国家自然科学基金;
关键词
Mathematical models; Numerical models; Kalman filters; Neural networks; Data models; Training; Data assimilation; fully connected neural network; machine learning; ensemble Kalman filter; Lorenz model; INTRINSIC NEED; ERROR;
D O I
10.1109/ACCESS.2021.3120482
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Using neural network technology, dynamic characteristics can be learned from model output or assimilation results to train the model, which has greatly progressed recently. A data-driven data assimilation method is proposed by combining fully connected neural network with ensemble Kalman filter to emulate dynamic models from sparse and noisy observations. First, the hybrid model couples the original dynamic model with the surrogate model. The surrogate model is learned from model forecast values and assimilation results, and its performance is verified using the training accuracy/loss and the validation accuracy/loss at different training times. Second, the assimilation process includes a "two-stage" procedure. Stage 0 generates the training sets and trains the surrogate model. Then, the hybrid model is used for the next assimilation period in Stage 1. Finally, several numerical experiments are conducted using the Lorenz-63 and Lorenz-96 models to demonstrate that the proposed approach is better than the ensemble Kalman filter in different model error covariances, observation error covariances, and observation time steps. The proposed approach has also been applied to sparse observations to improve assimilation performance. This hybrid model is restricted to the form of the ensemble Kalman filter. However, the basic strategy is not restricted to any particular version of the Kalman filter.
引用
收藏
页码:144952 / 144964
页数:13
相关论文
共 54 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]  
Anderson JL, 1999, MON WEATHER REV, V127, P2741, DOI 10.1175/1520-0493(1999)127<2741:AMCIOT>2.0.CO
[3]  
2
[4]  
Aster R. C., 2018, Parameter Estimation and Inverse Problems
[5]  
[摆玉龙 Bai Yulong], 2011, [地球科学进展, Advance in Earth Sciences], V26, P795
[6]   Evolutionary Algorithm-Based Error Parameterization Methods for Data Assimilation [J].
Bai, Yulong ;
Li, Xin .
MONTHLY WEATHER REVIEW, 2011, 139 (08) :2668-2685
[7]   A review of operational methods of variational and ensemble-variational data assimilation [J].
Bannister, R. N. .
QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY, 2017, 143 (703) :607-633
[8]   TFX: A TensorFlow-Based Production-Scale Machine Learning Platform [J].
Baylor, Denis ;
Breck, Eric ;
Cheng, Heng-Tze ;
Fiedel, Noah ;
Foo, Chuan Yu ;
Haque, Zakaria ;
Haykal, Salem ;
Ispir, Mustafa ;
Jain, Vihan ;
Koc, Levent ;
Koo, Chiu Yuen ;
Lew, Lukasz ;
Mewald, Clemens ;
Modi, Akshay Naresh ;
Polyzotis, Neoklis ;
Ramesh, Sukriti ;
Roy, Sudip ;
Whang, Steven Euijong ;
Wicke, Martin ;
Wilkiewicz, Jarek ;
Zhang, Xin ;
Zinkevich, Martin .
KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2017, :1387-1395
[9]   Expanding the validity of the ensemble Kalman filter without the intrinsic need for inflation [J].
Bocquet, M. ;
Raanes, P. N. ;
Hannart, A. .
NONLINEAR PROCESSES IN GEOPHYSICS, 2015, 22 (06) :645-662
[10]   Parameter-field estimation for atmospheric dispersion: application to the Chernobyl accident using 4D-Var [J].
Bocquet, M. .
QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY, 2012, 138 (664) :664-681