Physics and equality constrained artificial neural networks: Application to forward and inverse problems with multi-fidelity data fusion

被引:52
作者
Basir, Shamsulhaq [1 ]
Senocak, Inanc [1 ]
机构
[1] Univ Pittsburgh, Dept Mech Engn & Mat Sci, 3700 OHara St, Pittsburgh, PA 15261 USA
基金
美国国家科学基金会;
关键词
Constrained optimization; Augmented Lagrangian method; Residual neural networks; Partial differential equations; Forward and Inverse problems; Multi-fidelity learning; FEEDFORWARD NETWORKS; HELMHOLTZ-EQUATION; GLIOMA GROWTH; ALGORITHM; MODEL;
D O I
10.1016/j.jcp.2022.111301
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Physics-informed neural networks (PINNs) have been proposed to learn the solution of partial differential equations (PDE). In PINNs, the residual form of the PDE of interest and its boundary conditions are lumped into a composite objective function as soft penalties. Here, we show that this specific way of formulating the objective function is the source of severe limitations in the PINN approach when applied to different kinds of PDEs. To address these limitations, we propose a versatile framework based on a constrained optimization problem formulation, where we use the augmented Lagrangian method (ALM) to constrain the solution of a PDE with its boundary conditions and any high-fidelity data that may be available. Our approach is adept at forward and inverse problems with multi-fidelity data fusion. We demonstrate the efficacy and versatility of our physics-and equality-constrained deep-learning framework by applying it to several forward and inverse problems involving multi-dimensional PDEs. Our framework achieves orders of magnitude improvements in accuracy levels in comparison with state-of-the-art physics-informed neural networks. (C) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页数:18
相关论文
共 75 条
[1]  
Abadi M., 2016, P 12 USENIX C OP SYS
[2]   Numerical analysis of soil volumetric water content and temperature variations in an embankment due to soil-atmosphere interaction [J].
An, Ni ;
Hemmati, Sahar ;
Cui, Yujun .
COMPUTERS AND GEOTECHNICS, 2017, 83 :40-51
[3]  
[Anonymous], 2012, ARXIV
[4]  
[Anonymous], 2017, Commun. Math. Stat.
[5]  
Bahdanau D., 2015, ICLR
[6]   THE NUMERICAL-SOLUTION OF THE HELMHOLTZ-EQUATION FOR WAVE-PROPAGATION PROBLEMS IN UNDERWATER ACOUSTICS [J].
BAYLISS, A ;
GOLDSTEIN, CI ;
TURKEL, E .
COMPUTERS & MATHEMATICS WITH APPLICATIONS, 1985, 11 (7-8) :655-665
[7]  
Beck J., 1985, Inverse Heat Conduction: Ill-posed Problems
[8]   Analysis of the Generalization Error: Empirical Risk Minimization over Deep Artificial Neural Networks Overcomes the Curse of Dimensionality in the Numerical Approximation of Black-Scholes Partial Differential Equations [J].
Berner, Julius ;
Grohs, Philipp ;
Jentzen, Arnulf .
SIAM JOURNAL ON MATHEMATICS OF DATA SCIENCE, 2020, 2 (03) :631-657
[9]   MULTIPLIER METHODS - SURVEY [J].
BERTSEKAS, DP .
AUTOMATICA, 1976, 12 (02) :133-145
[10]  
Bierlaire M., 2015, Optimization: Principles and algorithms, V2e