Int-Deep: A deep learning initialized iterative method for nonlinear problems

被引:36
作者
Huang, Jianguo [1 ,2 ]
Wang, Haoqin [1 ,2 ]
Yang, Haizhao [3 ,4 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Math Sci, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, MOE LSC, Shanghai 200240, Peoples R China
[3] Purdue Univ, Dept Math, W Lafayette, IN 47907 USA
[4] Natl Univ Singapore, Dept Math, Singapore, Singapore
基金
美国国家科学基金会;
关键词
Deep learning; Nonlinear problems; Partial differential equations; Eigenvalue problems; Iterative methods; Fast and accurate; BOUNDARY-VALUE-PROBLEMS; NEURAL-NETWORKS; ERROR-BOUNDS; APPROXIMATIONS; EQUATION;
D O I
10.1016/j.jcp.2020.109675
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper proposes a deep-learning-initialized iterative method (Int-Deep) for low-dimensional nonlinear partial differential equations (PDEs). The corresponding framework consists of two phases. In the first phase, an expectation minimization problem formulated from a given nonlinear PDE is approximately resolved with mesh-free deep neural networks to parametrize the solution space. In the second phase, a solution ansatz of the finite element method to solve the given PDE is obtained from the approximate solution in the first phase, and the ansatz can serve as a good initial guess such that Newton's method or other iterative methods for solving the nonlinear PDE are able to converge to the ground truth solution with high-accuracy quickly. Systematic theoretical analysis is provided to justify the Int-Deep framework for several classes of problems. Numerical results show that the Int-Deep outperforms existing purely deep learning-based methods or traditional iterative methods (e.g., Newton's method and the Picard iteration method). (C) 2020 Elsevier Inc. All rights reserved.
引用
收藏
页数:24
相关论文
共 66 条
[1]  
Adams R.A., 2003, Sobolev spaces
[2]  
Ambrosetti A, 2007, CAM ST AD M, V104, P1, DOI 10.1017/CBO9780511618260
[3]   Bose-Einstein condensation of atomic gases [J].
Anglin, JR ;
Ketterle, W .
NATURE, 2002, 416 (6877) :211-218
[4]  
[Anonymous], 2017, ARXIV170703351
[5]   FINITE ELEMENT-GALERKIN APPROXIMATION OF THE EIGENVALUES AND EIGENVECTORS OF SELFADJOINT PROBLEMS [J].
BABUSKA, I ;
OSBORN, JE .
MATHEMATICS OF COMPUTATION, 1989, 52 (186) :275-297
[6]  
Babuska I., 1991, HDB NUMERICAL ANAL, P641
[7]   UNIVERSAL APPROXIMATION BOUNDS FOR SUPERPOSITIONS OF A SIGMOIDAL FUNCTION [J].
BARRON, AR .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1993, 39 (03) :930-945
[8]  
Bartels S., 2015, NUMERICAL METHODS NO, V47, DOI 10.1007/978-3-319-13797-16
[9]   SPECTRAL AND FINITE-DIFFERENCE SOLUTIONS OF THE BURGERS-EQUATION [J].
BASDEVANT, C ;
DEVILLE, M ;
HALDENWANG, P ;
LACROIX, JM ;
OUAZZANI, J ;
PEYRET, R ;
ORLANDI, P ;
PATERA, AT .
COMPUTERS & FLUIDS, 1986, 14 (01) :23-41
[10]   Solving initial-boundary value problems for systems of partial differential equations using neural networks and optimization techniques [J].
Beidokhti, R. Shekari ;
Malek, A. .
JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2009, 346 (09) :898-913