A fast and accurate physics-informed neural network reduced order model with shallow masked autoencoder

被引:117
作者
Kim, Youngkyu [1 ]
Choi, Youngsoo [2 ]
Widemann, David [3 ]
Zohdi, Tarek [1 ]
机构
[1] Univ Calif Berkeley, Mech Engn, Berkeley, CA 94720 USA
[2] Lawrence Livermore Natl Lab, Ctr Appl Sci Comp, Livermore, CA 94550 USA
[3] Lawrence Livermore Natl Lab, Computat Engn Div, Livermore, CA 94550 USA
关键词
Nonlinear manifold solution representation; Physics-informed neural network; Reduced order model; Nonlinear dynamical system; Hyper-reduction; PROPER ORTHOGONAL DECOMPOSITION; PARTIAL-DIFFERENTIAL-EQUATIONS; PETROV-GALERKIN PROJECTION; NONLINEAR MODEL; REDUCTION; INTERPOLATION; IMPLEMENTATION; ALGORITHM; SPACE;
D O I
10.1016/j.jcp.2021.110841
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Traditional linear subspace reduced order models (LS-ROMs) are able to accelerate physical simulations in which the intrinsic solution space falls into a subspace with a small dimension, i.e., the solution space has a small Kolmogorov n-width. However, for physical phenomena not of this type, e.g., any advection-dominated flow phenomena such as in traffic flow, atmospheric flows, and air flow over vehicles, a low-dimensional linear subspace poorly approximates the solution. To address cases such as these, we have developed a fast and accurate physics-informed neural network ROM, namely nonlinear manifold ROM (NM-ROM), which can better approximate high-fidelity model solutions with a smaller latent space dimension than the LS-ROMs. Our method takes advantage of the existing numerical methods that are used to solve the corresponding full order models. The efficiency is achieved by developing a hyper-reduction technique in the context of the NM-ROM. Numerical results show that neural networks can learn a more efficient latent space representation on advection-dominated data from 1D and 2D Burgers' equations. A speedup of up to 2.6 for 1D Burgers' and a speedup of 11.7 for 2D Burgers' equations are achieved with an appropriate treatment of the nonlinear terms through a hyper-reduction technique. Finally, a posteriori error bounds for the NM-ROMs are derived that take account of the hyper-reduced operators. (C) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页数:29
相关论文
共 77 条
[1]  
Abgrall R., 2016, Advanced Modeling and Simulation in Engineering Sciences, V3, P1, DOI DOI 10.1186/S40323-015-0055-3
[2]   Design optimization using hyper-reduced-order models [J].
Amsallem, David ;
Zahr, Matthew ;
Choi, Youngsoo ;
Farhat, Charbel .
STRUCTURAL AND MULTIDISCIPLINARY OPTIMIZATION, 2015, 51 (04) :919-940
[3]  
[Anonymous], 1974, Beyond Regression: New Tools for Prediction and Analysis in the Behavioral Science
[4]  
[Anonymous], 2018, ARXIV180703973
[5]  
[Anonymous], 2019, ARXIV191213024
[6]  
[Anonymous], 2009, P 26 ANN INT C MACH
[7]   Reduced order modeling based shape optimization of surface acoustic wave driven microfluidic biochips [J].
Antil, Harbir ;
Heinkenschloss, Matthias ;
Hoppe, Ronald H. W. ;
Linsenmann, Christopher ;
Wixforth, Achim .
MATHEMATICS AND COMPUTERS IN SIMULATION, 2012, 82 (10) :1986-2003
[8]   Machine Learning Approximation Algorithms for High-Dimensional Fully Nonlinear Partial Differential Equations and Second-order Backward Stochastic Differential Equations [J].
Beck, Christian ;
Weinan, E. ;
Jentzen, Arnulf .
JOURNAL OF NONLINEAR SCIENCE, 2019, 29 (04) :1563-1619
[9]   A Survey of Projection-Based Model Reduction Methods for Parametric Dynamical Systems [J].
Benner, Peter ;
Gugercin, Serkan ;
Willcox, Karen .
SIAM REVIEW, 2015, 57 (04) :483-531
[10]   A unified deep artificial neural network approach to partial differential equations in complex geometries [J].
Berg, Jens ;
Nystrom, Kaj .
NEUROCOMPUTING, 2018, 317 :28-41