DGM: A deep learning algorithm for solving partial differential equations

被引:1315
作者
Sirignano, Justin [1 ]
Spiliopoulos, Konstantinos [2 ]
机构
[1] Univ Illinois, Urbana, IL 61801 USA
[2] Boston Univ, Dept Math & Stat, Boston, MA 02215 USA
基金
美国国家科学基金会;
关键词
Partial differential equations; Machine learning; Deep learning; High-dimensional partial differential equations; NONLINEAR PARABOLIC EQUATIONS; AMERICAN OPTIONS; NEURAL-NETWORKS; APPROXIMATION; EXISTENCE; CONVERGENCE; NOISE;
D O I
10.1016/j.jcp.2018.08.029
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
High-dimensional PDEs have been a longstanding computational challenge. We propose to solve high-dimensional PDEs by approximating the solution with a deep neural network which is trained to satisfy the differential operator, initial condition, and boundary conditions. Our algorithm is meshfree, which is key since meshes become infeasible in higher dimensions. Instead of forming a mesh, the neural network is trained on batches of randomly sampled time and space points. The algorithm is tested on a class of high-dimensional free boundary PDEs, which we are able to accurately solve in up to 200 dimensions. The algorithm is also tested on a high-dimensional Hamilton-Jacobi-Bellman PDE and Burgers' equation. The deep learning algorithm approximates the general solution to the Burgers' equation for a continuum of different boundary conditions and physical conditions (which can be viewed as a high-dimensional space). We call the algorithm a "Deep Galerkin Method (DGM)" since it is similar in spirit to Galerkin methods, with the solution approximated by a neural network instead of a linear combination of basis functions. In addition, we prove a theorem regarding the approximation power of neural networks for a class of quasilinear parabolic PDEs. (C) 2018 Elsevier Inc. All rights reserved.
引用
收藏
页码:1339 / 1364
页数:26
相关论文
共 49 条
[1]  
[Anonymous], DEEP RELAXATION PART
[2]  
[Anonymous], ACTA NUMER
[3]  
[Anonymous], THESIS
[4]  
[Anonymous], ARXIV170905289V4
[5]  
[Anonymous], 2007, Stochastic Simulation: Algorithms and Analysis
[6]  
[Anonymous], 2012, NIPS
[7]  
[Anonymous], 2017, Physics informed deep learning (part ii): Data-driven discovery of nonlinear partial differential equations
[8]  
[Anonymous], 2017, ARXIV170905963
[9]  
[Anonymous], DEEP LEARNING BASED
[10]   Gradient convergence in gradient methods with errors [J].
Bertsekas, DP ;
Tsitsiklis, JN .
SIAM JOURNAL ON OPTIMIZATION, 2000, 10 (03) :627-642