DEEP NEURAL NETWORKS FOR SOLVING LARGE LINEAR SYSTEMS ARISING FROM HIGH-DIMENSIONAL PROBLEMS

被引:6
作者
Gu, Yiqi [1 ]
Ng, Michael K. [2 ]
机构
[1] Univ Elect Sci & Technol China, Sch Math Sci, Chengdu 611731, Sichuan, Peoples R China
[2] Hong Kong Baptist Univ, Dept Math, Kowloon Tong, Hong Kong, Peoples R China
关键词
very large scale linear systems; neural networks; partial differential equations; Riesz fractional diffusion; overflow queuing model; probabilistic Boolean networks; KRYLOV SUBSPACE METHODS; ITERATIVE METHODS; MULTIGRID PRECONDITIONERS; SPECTRAL-ANALYSIS; ERROR-BOUNDS; APPROXIMATION;
D O I
10.1137/22M1488132
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper studies deep neural networks for solving extremely large linear systems arising from high-dimensional problems. Because of the curse of dimensionality, it is expensive to store both the solution and right-hand side vector in such extremely large linear systems. Our idea is to employ a neural network to characterize the solution with many fewer parameters than the size of the solution under a matrix-free setting. We present an error analysis of the proposed method, indicating that the solution error is bounded by the condition number of the matrix and the neural network approximation error. Several numerical examples from partial differential equations, queueing problems, and probabilistic Boolean networks are presented to demonstrate that the solutions of linear systems can be learned quite accurately.
引用
收藏
页码:A2356 / A2381
页数:26
相关论文
共 55 条
[1]  
Allen-Zhu Z, 2019, ADV NEUR IN, V32
[2]  
Andoni A, 2014, PR MACH LEARN RES, V32, P1908
[3]   Motivations and realizations of Krylov subspace methods for large sparse linear systems [J].
Bai, Zhong-Zhi .
JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2015, 283 :71-78
[4]   A projection method to solve linear systems in tensor format [J].
Ballani, Jonas ;
Grasedyck, Lars .
NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS, 2013, 20 (01) :27-43
[5]  
BARRON A. R., 1992, P 7 YAL WORKSH AD LE
[6]   UNIVERSAL APPROXIMATION BOUNDS FOR SUPERPOSITIONS OF A SIGMOIDAL FUNCTION [J].
BARRON, AR .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1993, 39 (03) :930-945
[7]   On the condition numbers of large semi-definite Toeplitz matrices [J].
Bottcher, A ;
Grudsky, SM .
LINEAR ALGEBRA AND ITS APPLICATIONS, 1998, 279 (1-3) :285-301
[8]  
Cao Yuan, 2021, P 30 INT JOINT C ART
[9]  
Caragea A., 2020, arXiv
[10]   ITERATIVE METHODS FOR OVERFLOW QUEUING MODELS .2. [J].
CHAN, RH .
NUMERISCHE MATHEMATIK, 1988, 54 (01) :57-78