A High-Efficient Hybrid Physics-Informed Neural Networks Based on Convolutional Neural Network

被引:98
作者
Fang, Zhiwei [1 ]
机构
[1] NVIDIA Corp, Santa Clara, CA 95051 USA
关键词
Neural networks; Machine learning; Training; Learning systems; Inverse problems; Handheld computers; Geometry; Convolutional neural network (CNN); finite volume method; finite-difference method; hybrid physics-informed neural network (hybrid PINN); local fitting method;
D O I
10.1109/TNNLS.2021.3070878
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this article, we develop a hybrid physics-informed neural network (hybrid PINN) for partial differential equations (PDEs). We borrow the idea from the convolutional neural network (CNN) and finite volume methods. Unlike the physics-informed neural network (PINN) and its variations, the method proposed in this article uses an approximation of the differential operator to solve the PDEs instead of automatic differentiation (AD). The approximation is given by a local fitting method, which is the main contribution of this article. As a result, our method has been proved to have a convergent rate. This will also avoid the issue that the neural network gives a bad prediction, which sometimes happened in PINN. To the author's best knowledge, this is the first work that the machine learning PDE's solver has a convergent rate, such as in numerical methods. The numerical experiments verify the correctness and efficiency of our algorithm. We also show that our method can be applied in inverse problems and surface PDEs, although without proof.
引用
收藏
页码:5514 / 5526
页数:13
相关论文
共 34 条
[21]   Solving for high-dimensional committor functions using artificial neural networks [J].
Khoo, Yuehaw ;
Lu, Jianfeng ;
Ying, Lexing .
RESEARCH IN THE MATHEMATICAL SCIENCES, 2019, 6 (01)
[22]  
Li R.H., 2000, Generalized Difference Methods for Differential Equations: Numerical Analysis of Finite Volume Methods
[23]   Physics-informed neural networks for high-speed flows [J].
Mao, Zhiping ;
Jagtap, Ameya D. ;
Karniadakis, George Em .
COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2020, 360
[24]   Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations [J].
Raissi, M. ;
Perdikaris, P. ;
Karniadakis, G. E. .
JOURNAL OF COMPUTATIONAL PHYSICS, 2019, 378 :686-707
[25]   An energy approach to the solution of partial differential equations in computational mechanics via machine learning: Concepts, implementation and applications [J].
Samaniego, E. ;
Anitescu, C. ;
Goswami, S. ;
Nguyen-Thanh, V. M. ;
Guo, H. ;
Hamdia, K. ;
Zhuang, X. ;
Rabczuk, T. .
COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2020, 362
[26]  
Sampani K, 2020, INVEST OPHTH VIS SCI, V61
[27]   Physics-Informed Neural Network for Ultrasound Nondestructive Quantification of Surface Breaking Cracks [J].
Shukla, Khemraj ;
Di Leoni, Patricio Clark ;
Blackshire, James ;
Sparkman, Daniel ;
Karniadakis, George Em .
JOURNAL OF NONDESTRUCTIVE EVALUATION, 2020, 39 (03)
[28]  
Sobolev S.L., 2013, The Theory of Cubature Formulas, V415
[29]   Physics-constrained bayesian neural network for fluid flow reconstruction with sparse and noisy data [J].
Sun, Luning ;
Wang, Jian-Xun .
THEORETICAL AND APPLIED MECHANICS LETTERS, 2020, 10 (03) :161-169
[30]  
Wang S., 2020, When and why pinns fail to train: A neural tangent kernel perspective