ADLGM: An efficient adaptive sampling deep learning Galerkin method

被引:11
作者
Aristotelous, Andreas C. [1 ]
Mitchell, Edward C. [2 ]
Maroulas, Vasileios [2 ]
机构
[1] Univ Akron, Dept Math, Akron, OH 44325 USA
[2] Univ Tennessee, Dept Math, Knoxville, TN 37996 USA
关键词
Machine learning; Numerical solution; Partial differential equations; INFORMED NEURAL-NETWORKS; CAHN-HILLIARD EQUATION; DISCONTINUOUS GALERKIN; FRAMEWORK; ALGORITHM; 2ND-ORDER; TIME;
D O I
10.1016/j.jcp.2023.111944
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this paper, we devise an adaptive sampling technique applied to the deep Galerkin method (DGM), aimed to improve and speed up the training of the deep neural network when learning the solution of partial differential equations (PDEs). The proposed adaptive algorithm is inspired by the mesh adaptivity techniques used in the classical numerical PDE field. Its implementation to the DGM paradigm is natural, is done efficiently, and it is shown to improve the DGM algorithm. We demonstrate that our adaptive sampling DGM scheme is convergent and more accurate than DGM - as long as the residual mirrors the local error - at the same number of training steps and using the same or less number of training points. We present a multitude of tests applied to selected PDEs discussing the robustness of our scheme.(c) 2023 Elsevier Inc. All rights reserved.
引用
收藏
页数:17
相关论文
共 38 条
[1]  
Al-Aradi A, 2018, Arxiv, DOI arXiv:1811.08782
[2]  
Alnaes M, 2015, ARCHIVE NUMERICAL SO, V3, P9
[3]   Adaptive, second-order in time, primitive-variable discontinuous Galerkin schemes for a Cahn-Hilliard equation with a mass source [J].
Aristotelous, Andreas C. ;
Karakashian, Ohannes A. ;
Wise, Steven M. .
IMA JOURNAL OF NUMERICAL ANALYSIS, 2015, 35 (03) :1167-1198
[4]   A MIXED DISCONTINUOUS GALERKIN, CONVEX SPLITTING SCHEME FOR A MODIFIED CAHN-HILLIARD EQUATION AND AN EFFICIENT NONLINEAR MULTIGRID SOLVER [J].
Aristotelous, Andreas C. ;
Krakashian, Ohannes ;
Wise, Steven M. .
DISCRETE AND CONTINUOUS DYNAMICAL SYSTEMS-SERIES B, 2013, 18 (09) :2211-2238
[5]   Machine Learning Approximation Algorithms for High-Dimensional Fully Nonlinear Partial Differential Equations and Second-order Backward Stochastic Differential Equations [J].
Beck, Christian ;
Weinan, E. ;
Jentzen, Arnulf .
JOURNAL OF NONLINEAR SCIENCE, 2019, 29 (04) :1563-1619
[6]   A unified deep artificial neural network approach to partial differential equations in complex geometries [J].
Berg, Jens ;
Nystrom, Kaj .
NEUROCOMPUTING, 2018, 317 :28-41
[7]  
Berner J, 2020, Arxiv, DOI arXiv:2011.04602
[8]  
BRAMBLE J.H., 1993, MULTIGRID METHODS
[9]  
Brenner S.C., 1994, MATH THEORY FINITE E, DOI DOI 10.1007/978-0-387-75934-0
[10]   Multigrid algorithms for C0 interior penalty methods [J].
Brenner, SC ;
Sung, LY .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 2006, 44 (01) :199-223