Recurrent neural networks and Koopman-based frameworks for temporal predictions in a low-order model of turbulence

被引:54
作者
Eivazi, Hamidreza [1 ]
Guastoni, Luca [2 ,3 ]
Schlatter, Philipp [2 ,3 ]
Azizpour, Hossein [3 ,4 ]
Vinuesa, Ricardo [2 ,3 ]
机构
[1] Univ Tehran, Fac New Sci & Technol, Tehran, Iran
[2] KTH Royal Inst Technol, SimEx FLOW, Engn Mech, SE-10044 Stockholm, Sweden
[3] Swedish E Sci Res Ctr SeRC, Stockholm, Sweden
[4] KTH Royal Inst Technol, Sch EECS, Div Robot Percept & Learning, Stockholm, Sweden
关键词
Dynamical systems; Machine learning; Data-driven modeling; Recurrent neural networks; Koopman operator; SPECTRAL PROPERTIES; DYNAMICAL-SYSTEMS; DECOMPOSITION; FLOWS;
D O I
10.1016/j.ijheatfluidflow.2021.108816
中图分类号
O414.1 [热力学];
学科分类号
摘要
The capabilities of recurrent neural networks and Koopman-based frameworks are assessed in the prediction of temporal dynamics of the low-order model of near-wall turbulence by Moehlis et al. (New J. Phys. 6, 56, 2004). Our results show that it is possible to obtain excellent reproductions of the long-term statistics and the dynamic behavior of the chaotic system with properly trained long-short-term memory (LSTM) networks, leading to relative errors in the mean and the fluctuations below 1%. Besides, a newly developed Koopman-based framework, called Koopman with nonlinear forcing (KNF), leads to the same level of accuracy in the statistics at a significantly lower computational expense. Furthermore, the KNF framework outperforms the LSTM network when it comes to short-term predictions. We also observe that using a loss function based only on the instantaneous predictions of the chaotic system can lead to suboptimal reproductions in terms of long-term statistics. Thus, we propose a model-selection criterion based on the computed statistics which allows to achieve excellent statistical reconstruction even on small datasets, with minimal loss of accuracy in the instantaneous predictions.
引用
收藏
页数:14
相关论文
共 69 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]   THE ANALYSIS OF OBSERVED CHAOTIC DATA IN PHYSICAL SYSTEMS [J].
ABARBANEL, HDI ;
BROWN, R ;
SIDOROWICH, JJ ;
TSIMRING, LS .
REVIEWS OF MODERN PHYSICS, 1993, 65 (04) :1331-1392
[3]   Study of dynamics in post-transient flows using Koopman mode decomposition [J].
Arbabi, Hassan ;
Mezic, Igor .
PHYSICAL REVIEW FLUIDS, 2017, 2 (12)
[4]   Ergodic Theory, Dynamic Mode Decomposition, and Computation of Spectral Properties of the Koopman Operator [J].
Arbabi, Hassan ;
Mezic, Igor .
SIAM JOURNAL ON APPLIED DYNAMICAL SYSTEMS, 2017, 16 (04) :2096-2126
[5]   Deep neural networks for data-driven LES closure models [J].
Beck, Andrea ;
Flad, David ;
Munz, Claus-Dieter .
JOURNAL OF COMPUTATIONAL PHYSICS, 2019, 398
[6]   Estimation of perturbations in robotic behavior using dynamic mode decomposition [J].
Berger, Erik ;
Sastuba, Mark ;
Vogt, David ;
Jung, Bernhard ;
Ben Amor, Heni .
ADVANCED ROBOTICS, 2015, 29 (05) :331-343
[7]   Extended proper orthogonal decomposition:: a tool to analyse correlated events in turbulent flows [J].
Borée, J .
EXPERIMENTS IN FLUIDS, 2003, 35 (02) :188-192
[8]   Extracting spatial-temporal coherent patterns in large-scale neural recordings using dynamic mode decomposition [J].
Brunton, Bingni W. ;
Johnson, Lise A. ;
Ojemann, Jeffrey G. ;
Kutz, J. Nathan .
JOURNAL OF NEUROSCIENCE METHODS, 2016, 258 :1-15
[9]   Machine Learning for Fluid Mechanics [J].
Brunton, Steven L. ;
Noack, Bernd R. ;
Koumoutsakos, Petros .
ANNUAL REVIEW OF FLUID MECHANICS, VOL 52, 2020, 52 :477-508
[10]   Chaos as an intermittently forced linear system [J].
Brunton, Steven L. ;
Brunton, Bingni W. ;
Proctor, Joshua L. ;
Kaiser, Eurika ;
Kutz, J. Nathan .
NATURE COMMUNICATIONS, 2017, 8