EXPONENTIAL CONVERGENCE OF DEEP OPERATOR NETWORKS FOR ELLIPTIC PARTIAL DIFFERENTIAL EQUATIONS*

被引:10
作者
Marcati, Carlo [1 ]
Schwab, Christoph [1 ,2 ]
机构
[1] Swiss Fed Inst Technol, Seminar Appl Math, CH-8092 Zurich, Switzerland
[2] Univ Pavia, Dipartimento Matemat F Casorati, I-27100 Pavia, Italy
关键词
operator networks; deep neural networks; exponential convergence; elliptic PDEs; NEURAL-NETWORKS; UNIVERSAL APPROXIMATION;
D O I
10.1137/21M1465718
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We prove exponential expression rates of deep operator networks (deep ONets) between infinite-dimensional spaces that emulate the coefficient-to-solution map of linear, elliptic, second-order, divergence-form partial differential equations (PDEs). In particular, we consider prob-lems set in d -dimensional periodic domains, d = 1, 2, ... , with analytic right-hand sides and coeffi-cients. Our analysis covers diffusion-reaction problems, parametric diffusion equations, and certain elliptic systems such as linear isotropic elastostatics in heterogeneous materials. In the constructive proofs, we leverage the exponential convergence of spectral collocation methods for boundary value problems whose solutions are analytic. In the present periodic and analytic setting, this follows from classical elliptic regularity. Within the branch and trunk ONet architecture of Chen and Chen [IEEE. Trans. Nural Netw., 4 (1993), pp. 910--918] and of Lu et al. [Nat. Mach. Intell., 3 (2021), pp. 218-229], we construct deep ONets which emulate the coefficient-to-solution map to a desired accuracy in the H1 norm, uniformly over the PDE coefficient set. The ONets have size O(| log(E)|\kappa), where E > 0 is the approximation accuracy, for some \kappa > 0 depending on the physical space dimension.
引用
收藏
页码:1513 / 1545
页数:33
相关论文
共 31 条
[1]   Machine Learning Approximation Algorithms for High-Dimensional Fully Nonlinear Partial Differential Equations and Second-order Backward Stochastic Differential Equations [J].
Beck, Christian ;
Weinan, E. ;
Jentzen, Arnulf .
JOURNAL OF NONLINEAR SCIENCE, 2019, 29 (04) :1563-1619
[2]   Physics-informed neural networks (PINNs) for fluid mechanics: a review [J].
Cai, Shengze ;
Mao, Zhiping ;
Wang, Zhicheng ;
Yin, Minglang ;
Karniadakis, George Em .
ACTA MECHANICA SINICA, 2021, 37 (12) :1727-1738
[3]  
Canuto C., 2006, SCIENTIF COMPUT
[4]   APPROXIMATIONS OF CONTINUOUS FUNCTIONALS BY NEURAL NETWORKS WITH APPLICATION TO DYNAMIC-SYSTEMS [J].
CHEN, TP ;
CHEN, H .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1993, 4 (06) :910-918
[5]  
Cioranescu D., 1999, OXFORD LECT SERIES M, V17
[6]   Exponential convergence of hp-FEM for Maxwell equations with weighted regularization in polygonal domains [J].
Costabel, M ;
Dauge, M ;
Schwab, C .
MATHEMATICAL MODELS & METHODS IN APPLIED SCIENCES, 2005, 15 (04) :575-622
[7]  
COSTABEL M., 2010, PREPRINTS
[8]  
De Ryck T, 2022, Arxiv, DOI arXiv:2205.11393
[9]   Approximation rates of DeepONets for learning operators arising from advection-diffusion equations [J].
Deng, Beichuan ;
Shin, Yeonjong ;
Lu, Lu ;
Zhang, Zhongqiang ;
Karniadakis, George Em .
NEURAL NETWORKS, 2022, 153 :411-426
[10]   Deep Neural Network Approximation Theory [J].
Elbrachter, Dennis ;
Perekrestenko, Dmytro ;
Grohs, Philipp ;
Boelcskei, Helmut .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2021, 67 (05) :2581-2623