Multi-fidelity surrogate modeling using long short-term memory networks

被引:36
|
作者
Conti, Paolo [1 ]
Guo, Mengwu [2 ]
Manzoni, Andrea [3 ]
Hesthaven, Jan S. [4 ]
机构
[1] Politecn Milan, Dept Civil Engn, Milan, Italy
[2] Univ Twente, Dept Appl Math, Enschede, Netherlands
[3] Politecn Milan, Dept Math, MOX, Milan, Italy
[4] Ecole Polytech Fed Lausanne, Inst Math, Lausanne, Switzerland
关键词
Machine learning; Multi-fidelity regression; LSTM network; Parametrized PDE; Time-dependent problem; APPROXIMATION;
D O I
10.1016/j.cma.2022.115811
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
When evaluating quantities of interest that depend on the solutions to differential equations, we inevitably face the trade-off between accuracy and efficiency. Especially for parametrized, time-dependent problems in engineering computations, it is often the case that acceptable computational budgets limit the availability of high-fidelity, accurate simulation data. Multi-fidelity surrogate modeling has emerged as an effective strategy to overcome this difficulty. Its key idea is to leverage many low-fidelity simulation data, less accurate but much faster to compute, to improve the approximations with limited high-fidelity data. In this work, we introduce a novel data-driven framework of multi-fidelity surrogate modeling for parametrized, time-dependent problems using long short-term memory (LSTM) networks, to enhance output predictions both for unseen parameter values and forward in time simultaneously - a task known to be particularly challenging for data-driven models. We demonstrate the wide applicability of the proposed approaches in a variety of engineering problems with high-and low-fidelity data generated through fine versus coarse meshes, small versus large time steps, or finite element full order versus deep learning reduced-order models. Numerical results show that the proposed multi-fidelity LSTM networks not only improve single-fidelity regression significantly, but also outperform the multi-fidelity models based on feed-forward neural networks.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] SCGAN: stacking-based generative adversarial networks for multi-fidelity surrogate modeling
    Chao Zhang
    Lixue Liu
    Hao Wang
    Xueguan Song
    Dacheng Tao
    Structural and Multidisciplinary Optimization, 2022, 65
  • [2] SCGAN: stacking-based generative adversarial networks for multi-fidelity surrogate modeling
    Zhang, Chao
    Liu, Lixue
    Wang, Hao
    Song, Xueguan
    Tao, Dacheng
    STRUCTURAL AND MULTIDISCIPLINARY OPTIMIZATION, 2022, 65 (06)
  • [3] Modeling injection-induced fault slip using long short-term memory networks
    Mital, Utkarsh
    Hu, Mengsu
    Guglielmi, Yves
    Brown, James
    Rutqvist, Jonny
    JOURNAL OF ROCK MECHANICS AND GEOTECHNICAL ENGINEERING, 2024, 16 (11) : 4354 - 4368
  • [4] Multi-fidelity Gaussian process surrogate modeling for regression problems in physics
    Ravi, Kislaya
    Fediukov, Vladyslav
    Dietrich, Felix
    Neckel, Tobias
    Buse, Fabian
    Bergmann, Michael
    Bungartz, Hans-Joachim
    MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2024, 5 (04):
  • [5] Using long short-term memory networks for river flow prediction
    Xu, Wei
    Jiang, Yanan
    Zhang, Xiaoli
    Li, Yi
    Zhang, Run
    Fu, Guangtao
    HYDROLOGY RESEARCH, 2020, 51 (06): : 1358 - 1376
  • [6] Descriptor Free QSAR Modeling Using Deep Learning With Long Short-Term Memory Neural Networks
    Chakravarti, Suman K.
    Alla, Sai Radha Mani
    FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2019, 2
  • [7] Adaptive experimental design for multi-fidelity surrogate modeling of multi-disciplinary systems
    Jakeman, John D.
    Friedman, Sam
    Eldred, Michael S.
    Tamellini, Lorenzo
    Gorodetsky, Alex A.
    Allaire, Doug
    INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN ENGINEERING, 2022, 123 (12) : 2760 - 2790
  • [8] Multi-fidelity surrogate modeling for temperature field prediction using deep convolution neural network
    Zhang, Yunyang
    Gong, Zhiqiang
    Zhou, Weien
    Zhao, Xiaoyu
    Zheng, Xiaohu
    Yao, Wen
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
  • [9] An Incremental Learning Approach Using Long Short-Term Memory Neural Networks
    Lemos Neto, Alvaro C.
    Coelho, Rodrigo A.
    de Castro, Cristiano L.
    JOURNAL OF CONTROL AUTOMATION AND ELECTRICAL SYSTEMS, 2022, 33 (05) : 1457 - 1465
  • [10] Spectrum Usage Analysis And Prediction using Long Short-Term Memory Networks
    Ghosh, Anneswa
    Van der Merwe, Jacobus
    Kasera, Sneha Kumar
    PROCEEDINGS OF THE 24TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING AND NETWORKING, ICDCN 2023, 2023, : 270 - 279