Recurrent neural networks and Koopman-based frameworks for temporal predictions in a low-order model of turbulence

被引:53
|
作者
Eivazi, Hamidreza [1 ]
Guastoni, Luca [2 ,3 ]
Schlatter, Philipp [2 ,3 ]
Azizpour, Hossein [3 ,4 ]
Vinuesa, Ricardo [2 ,3 ]
机构
[1] Univ Tehran, Fac New Sci & Technol, Tehran, Iran
[2] KTH Royal Inst Technol, SimEx FLOW, Engn Mech, SE-10044 Stockholm, Sweden
[3] Swedish E Sci Res Ctr SeRC, Stockholm, Sweden
[4] KTH Royal Inst Technol, Sch EECS, Div Robot Percept & Learning, Stockholm, Sweden
关键词
Dynamical systems; Machine learning; Data-driven modeling; Recurrent neural networks; Koopman operator; SPECTRAL PROPERTIES; DYNAMICAL-SYSTEMS; DECOMPOSITION; FLOWS;
D O I
10.1016/j.ijheatfluidflow.2021.108816
中图分类号
O414.1 [热力学];
学科分类号
摘要
The capabilities of recurrent neural networks and Koopman-based frameworks are assessed in the prediction of temporal dynamics of the low-order model of near-wall turbulence by Moehlis et al. (New J. Phys. 6, 56, 2004). Our results show that it is possible to obtain excellent reproductions of the long-term statistics and the dynamic behavior of the chaotic system with properly trained long-short-term memory (LSTM) networks, leading to relative errors in the mean and the fluctuations below 1%. Besides, a newly developed Koopman-based framework, called Koopman with nonlinear forcing (KNF), leads to the same level of accuracy in the statistics at a significantly lower computational expense. Furthermore, the KNF framework outperforms the LSTM network when it comes to short-term predictions. We also observe that using a loss function based only on the instantaneous predictions of the chaotic system can lead to suboptimal reproductions in terms of long-term statistics. Thus, we propose a model-selection criterion based on the computed statistics which allows to achieve excellent statistical reconstruction even on small datasets, with minimal loss of accuracy in the instantaneous predictions.
引用
收藏
页数:14
相关论文
共 37 条
  • [1] Neural Networks for the Estimation of Low-Order Statistical Moments of a Stochastic Dielectric
    Stenmark, Simon
    Rylander, Thomas
    McKelvey, Tomas
    2021 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE (I2MTC 2021), 2021,
  • [2] Data-driven inference of low-order isostable-coordinate-based dynamical models using neural networks
    Ahmed, Talha
    Sadovnik, Amir
    Wilson, Dan
    NONLINEAR DYNAMICS, 2023, 111 (03) : 2501 - 2519
  • [3] A generative model of a limit order book using recurrent neural networks
    Hultin, Hanna
    Hult, Henrik
    Proutiere, Alexandre
    Samama, Samuel
    Tarighati, Ala
    QUANTITATIVE FINANCE, 2023, 23 (06) : 931 - 958
  • [4] Constructing Low-Order Discriminant Neural Networks Using Statistical Feature Selection
    Henderson, Eric
    Martinez, Tony
    JOURNAL OF INTELLIGENT SYSTEMS, 2007, 16 (01) : 27 - 56
  • [5] REDUCED ORDER MODEL FOR UNSTEADY FLUID FLOWS VIA RECURRENT NEURAL NETWORKS
    Reddy, Sandeep B.
    Magee, Allan Ross
    Jaiman, Rajeev K.
    Liu, J.
    Xu, W.
    Choudhary, A.
    Hussain, A. A.
    PROCEEDINGS OF THE ASME 38TH INTERNATIONAL CONFERENCE ON OCEAN, OFFSHORE AND ARCTIC ENGINEERING, 2019, VOL 2, 2019,
  • [6] Minimal model dimension/order determination algorithms for recurrent neural networks
    Wang, Jeen-Shing
    Hsu, Yu-Liang
    Lin, Hung-Yi
    Chen, Yen-Ping
    PATTERN RECOGNITION LETTERS, 2009, 30 (09) : 812 - 819
  • [7] A Generative Model Based Chatbot Using Recurrent Neural Networks
    Raj, Vinay
    Phridviraj, M. S. B.
    ADVANCED NETWORK TECHNOLOGIES AND INTELLIGENT COMPUTING, ANTIC 2022, PT II, 2023, 1798 : 379 - 392
  • [8] Development of a recurrent neural networks-based calving prediction model using activity and behavioral data
    Keceli, Ali Seydi
    Catal, Cagatay
    Kaya, Aydin
    Tekinerdogan, Bedir
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2020, 170 (170)
  • [9] Recurrent neural networks based paraphrase identification model combined with attention mechanism
    Li X.
    Yao C.-L.
    Fan F.-L.
    Yu X.-Q.
    Li, Xu (lixu102@aliyun.com), 1600, Northeast University (36): : 152 - 158
  • [10] Credit Card Fraud Detection Model Based on LSTM Recurrent Neural Networks
    Benchaji, Ibtissam
    Douzi, Samira
    El Ouahidi, Bouabid
    JOURNAL OF ADVANCES IN INFORMATION TECHNOLOGY, 2021, 12 (02) : 113 - 118