Physics and equality constrained artificial neural networks: Application to forward and inverse problems with multi-fidelity data fusion

被引:38
作者
Basir, Shamsulhaq [1 ]
Senocak, Inanc [1 ]
机构
[1] Univ Pittsburgh, Dept Mech Engn & Mat Sci, 3700 OHara St, Pittsburgh, PA 15261 USA
基金
美国国家科学基金会;
关键词
Constrained optimization; Augmented Lagrangian method; Residual neural networks; Partial differential equations; Forward and Inverse problems; Multi-fidelity learning; FEEDFORWARD NETWORKS; HELMHOLTZ-EQUATION; GLIOMA GROWTH; ALGORITHM; MODEL;
D O I
10.1016/j.jcp.2022.111301
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Physics-informed neural networks (PINNs) have been proposed to learn the solution of partial differential equations (PDE). In PINNs, the residual form of the PDE of interest and its boundary conditions are lumped into a composite objective function as soft penalties. Here, we show that this specific way of formulating the objective function is the source of severe limitations in the PINN approach when applied to different kinds of PDEs. To address these limitations, we propose a versatile framework based on a constrained optimization problem formulation, where we use the augmented Lagrangian method (ALM) to constrain the solution of a PDE with its boundary conditions and any high-fidelity data that may be available. Our approach is adept at forward and inverse problems with multi-fidelity data fusion. We demonstrate the efficacy and versatility of our physics-and equality-constrained deep-learning framework by applying it to several forward and inverse problems involving multi-dimensional PDEs. Our framework achieves orders of magnitude improvements in accuracy levels in comparison with state-of-the-art physics-informed neural networks. (C) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页数:18
相关论文
共 75 条
  • [1] Abadi M, 2023, TENSORFLOW SYSTEM LA
  • [2] Numerical analysis of soil volumetric water content and temperature variations in an embankment due to soil-atmosphere interaction
    An, Ni
    Hemmati, Sahar
    Cui, Yujun
    [J]. COMPUTERS AND GEOTECHNICS, 2017, 83 : 40 - 51
  • [3] [Anonymous], 2017, COMMUN MATH STAT
  • [4] Bahdanau D., 2014, CORR, DOI DOI 10.48550/ARXIV.1409.0473
  • [5] THE NUMERICAL-SOLUTION OF THE HELMHOLTZ-EQUATION FOR WAVE-PROPAGATION PROBLEMS IN UNDERWATER ACOUSTICS
    BAYLISS, A
    GOLDSTEIN, CI
    TURKEL, E
    [J]. COMPUTERS & MATHEMATICS WITH APPLICATIONS, 1985, 11 (7-8) : 655 - 665
  • [6] Analysis of the Generalization Error: Empirical Risk Minimization over Deep Artificial Neural Networks Overcomes the Curse of Dimensionality in the Numerical Approximation of Black-Scholes Partial Differential Equations
    Berner, Julius
    Grohs, Philipp
    Jentzen, Arnulf
    [J]. SIAM JOURNAL ON MATHEMATICS OF DATA SCIENCE, 2020, 2 (03): : 631 - 657
  • [7] MULTIPLIER METHODS - SURVEY
    BERTSEKAS, DP
    [J]. AUTOMATICA, 1976, 12 (02) : 133 - 145
  • [8] Bierlaire M., 2015, Optimization: Principles and algorithms
  • [9] Distributed optimization and statistical learning via the alternating direction method of multipliers
    Boyd S.
    Parikh N.
    Chu E.
    Peleato B.
    Eckstein J.
    [J]. Foundations and Trends in Machine Learning, 2010, 3 (01): : 1 - 122
  • [10] Machine Learning for Fluid Mechanics
    Brunton, Steven L.
    Noack, Bernd R.
    Koumoutsakos, Petros
    [J]. ANNUAL REVIEW OF FLUID MECHANICS, VOL 52, 2020, 52 : 477 - 508