ADLGM: An efficient adaptive sampling deep learning Galerkin method

被引:10
|
作者
Aristotelous, Andreas C. [1 ]
Mitchell, Edward C. [2 ]
Maroulas, Vasileios [2 ]
机构
[1] Univ Akron, Dept Math, Akron, OH 44325 USA
[2] Univ Tennessee, Dept Math, Knoxville, TN 37996 USA
关键词
Machine learning; Numerical solution; Partial differential equations; INFORMED NEURAL-NETWORKS; CAHN-HILLIARD EQUATION; DISCONTINUOUS GALERKIN; FRAMEWORK; ALGORITHM; 2ND-ORDER; TIME;
D O I
10.1016/j.jcp.2023.111944
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this paper, we devise an adaptive sampling technique applied to the deep Galerkin method (DGM), aimed to improve and speed up the training of the deep neural network when learning the solution of partial differential equations (PDEs). The proposed adaptive algorithm is inspired by the mesh adaptivity techniques used in the classical numerical PDE field. Its implementation to the DGM paradigm is natural, is done efficiently, and it is shown to improve the DGM algorithm. We demonstrate that our adaptive sampling DGM scheme is convergent and more accurate than DGM - as long as the residual mirrors the local error - at the same number of training steps and using the same or less number of training points. We present a multitude of tests applied to selected PDEs discussing the robustness of our scheme.(c) 2023 Elsevier Inc. All rights reserved.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Adaptive trajectories sampling for solving PDEs with deep learning methods
    Chen, Xingyu
    Cen, Jianhuan
    Zou, Qingsong
    APPLIED MATHEMATICS AND COMPUTATION, 2024, 481
  • [2] Extensions of the deep Galerkin method
    Al-Aradi, Ali
    Correia, Adolfo
    Jardim, Gabriel
    Naiff, Danilo de Freitas
    Saporito, Yuri
    APPLIED MATHEMATICS AND COMPUTATION, 2022, 430
  • [3] The Deep Learning Galerkin Method for the General Stokes Equations
    Li, Jian
    Yue, Jing
    Zhang, Wen
    Duan, Wansuo
    JOURNAL OF SCIENTIFIC COMPUTING, 2022, 93 (01)
  • [4] r-Adaptive deep learning method for solving partial differential equations
    Omella, Angel J.
    Pardo, David
    COMPUTERS & MATHEMATICS WITH APPLICATIONS, 2024, 153 : 33 - 42
  • [5] An Optimal Control Deep Learning Method to Design Artificial Viscosities for Discontinuous Galerkin Schemes
    Bois, Leo
    Franck, Emmanuel
    Navoret, Laurent
    Vigon, Vincent
    JOURNAL OF SCIENTIFIC COMPUTING, 2024, 101 (03)
  • [6] Coupling parameter and particle dynamics for adaptive sampling in Neural Galerkin schemes
    Wen, Yuxiao
    Vanden-Eijnden, Eric
    Peherstorfer, Benjamin
    PHYSICA D-NONLINEAR PHENOMENA, 2024, 462
  • [7] Implicit Bias in Understanding Deep Learning for Solving PDEs Beyond Ritz-Galerkin Method
    Wang, Jihong
    Xu, Zhi-Qin John
    Zhang, Jiwei
    Zhang, Yaoyu
    CSIAM TRANSACTIONS ON APPLIED MATHEMATICS, 2022, 3 (02): : 299 - 317
  • [8] NanoDeep: a deep learning framework for nanopore adaptive sampling on microbial sequencing
    Lin, Yusen
    Zhang, Yongjun
    Sun, Hang
    Jiang, Hang
    Zhao, Xing
    Teng, Xiaojuan
    Lin, Jingxia
    Shu, Bowen
    Sun, Hao
    Liao, Yuhui
    Zhou, Jiajian
    BRIEFINGS IN BIOINFORMATICS, 2024, 25 (01)
  • [9] A modified adaptive synthetic sampling method for learning imbalanced datasets
    Hussein, Ahmed Saad
    Li, Tianrui
    Abd Ali, Doaa Mohsin
    Bashir, Kamal
    Yohannese, Chubato Wondaferaw
    DEVELOPMENTS OF ARTIFICIAL INTELLIGENCE TECHNOLOGIES IN COMPUTATION AND ROBOTICS, 2020, 12 : 76 - 83
  • [10] A DEEP LEARNING GALERKIN METHOD FOR THE SECOND-ORDER LINEAR ELLIPTIC EQUATIONS
    Li, Jian
    Zhang, Wen
    Yue, Jing
    INTERNATIONAL JOURNAL OF NUMERICAL ANALYSIS AND MODELING, 2021, 18 (04) : 427 - 441