ADLGM: An efficient adaptive sampling deep learning Galerkin method

被引:11
作者
Aristotelous, Andreas C. [1 ]
Mitchell, Edward C. [2 ]
Maroulas, Vasileios [2 ]
机构
[1] Univ Akron, Dept Math, Akron, OH 44325 USA
[2] Univ Tennessee, Dept Math, Knoxville, TN 37996 USA
关键词
Machine learning; Numerical solution; Partial differential equations; INFORMED NEURAL-NETWORKS; CAHN-HILLIARD EQUATION; DISCONTINUOUS GALERKIN; FRAMEWORK; ALGORITHM; 2ND-ORDER; TIME;
D O I
10.1016/j.jcp.2023.111944
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this paper, we devise an adaptive sampling technique applied to the deep Galerkin method (DGM), aimed to improve and speed up the training of the deep neural network when learning the solution of partial differential equations (PDEs). The proposed adaptive algorithm is inspired by the mesh adaptivity techniques used in the classical numerical PDE field. Its implementation to the DGM paradigm is natural, is done efficiently, and it is shown to improve the DGM algorithm. We demonstrate that our adaptive sampling DGM scheme is convergent and more accurate than DGM - as long as the residual mirrors the local error - at the same number of training steps and using the same or less number of training points. We present a multitude of tests applied to selected PDEs discussing the robustness of our scheme.(c) 2023 Elsevier Inc. All rights reserved.
引用
收藏
页数:17
相关论文
共 38 条
[21]   Solving parametric PDE problems with artificial neural networks [J].
Khoo, Yuehaw ;
Lu, Jianfeng ;
Ying, Lexing .
EUROPEAN JOURNAL OF APPLIED MATHEMATICS, 2021, 32 (03) :421-435
[22]   Machine learning-accelerated computational fluid dynamics [J].
Kochkov, Dmitrii ;
Smith, Jamie A. ;
Alieva, Ayya ;
Wang, Qing ;
Brenner, Michael P. ;
Hoyer, Stephan .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2021, 118 (21)
[23]  
LeVeque RJ, 2007, OTHER TITL APPL MATH, V98, P1, DOI 10.1137/1.9780898717839
[24]  
Logg A., 2012, Automated Solution of Differential Equations by the Finite Element Method, DOI [DOI 10.1007/978-3-642-23099-8, 10.1007/978-3-642-23099-8]
[25]  
Love E., 2021, arXiv
[26]   DeepXDE: A Deep Learning Library for Solving Differential Equations [J].
Lu, Lu ;
Meng, Xuhui ;
Mao, Zhiping ;
Karniadakis, George Em .
SIAM REVIEW, 2021, 63 (01) :208-228
[27]  
Bronstein MMM, 2021, Arxiv, DOI [arXiv:2104.13478, 10.48550/arXiv.2104.13478]
[28]   A Bayesian Framework for Persistent Homology [J].
Maroulas, Vasileios ;
Nasrin, Farzana ;
Oballe, Christopher .
SIAM JOURNAL ON MATHEMATICS OF DATA SCIENCE, 2020, 2 (01) :48-74
[29]  
Maroulas V, 2019, J MACH LEARN RES, V20
[30]  
McClenny L., 2020, arXiv