ANALYTICAL LOW-RANK COMPRESSION VIA PROXY POINT SELECTION

被引:12
作者
Ye, Xin [1 ]
Xia, Jianlin [1 ]
Ying, Lexing [2 ,3 ]
机构
[1] Purdue Univ, Dept Math, W Lafayette, IN 47907 USA
[2] Stanford Univ, Dept Math, Stanford, CA 94305 USA
[3] Stanford Univ, Inst Computat & Math Engn, Stanford, CA 94305 USA
基金
美国国家科学基金会;
关键词
kernel matrix; proxy point method; low-rank approximation; approximation error analysis; hybrid compression; strong rank-revealing factorization; FAST MULTIPOLE METHOD; FAST DIRECT SOLVER; LINEAR-SYSTEMS; FAST ALGORITHM; NYSTROM METHOD; MATRIX; APPROXIMATION; RANDOMIZATION; FACTORIZATION; EIGENSOLVER;
D O I
10.1137/19M1247838
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
It has been known in potential theory that, for some kernel matrices corresponding to well-separated point sets, fast analytical low-rank approximation can be achieved via the use of proxy points. This proxy point method gives a surprisingly convenient way of explicitly writing out approximate basis matrices for a kernel matrix. However, this elegant strategy is rarely known or used in the numerical linear algebra community. It still needs clear algebraic understanding of the theoretical background. Moreover, rigorous quantifications of the approximation errors and reliable criteria for the selection of the proxy points are still missing. In this work, we use contour integration to clearly justify the idea in terms of a class of important kernels. We further provide comprehensive accuracy analysis for the analytical compression and show how to choose nearly optimal proxy points. The analytical compression is then combined with fast rank-revealing factorizations to get compact low-rank approximations and also to select certain representative points. We provide the error bounds for the resulting overall low-rank approximation. This work thus gives a fast and reliable strategy for compressing those kernel matrices. Furthermore, it provides an intuitive way of understanding the proxy point method and bridges the gap between this useful analytical strategy and practical low-rank approximations. Some numerical examples help to further illustrate the ideas.
引用
收藏
页码:1059 / 1085
页数:27
相关论文
共 56 条
[11]   The black-box fast multipole method [J].
Fong, William ;
Darve, Eric .
JOURNAL OF COMPUTATIONAL PHYSICS, 2009, 228 (23) :8712-8725
[12]  
Gilbert J. R., MATLAB MESH PARTITIO
[13]   A direct solver with O(N) complexity for integral equations on one-dimensional domains [J].
Gillman, Adrianna ;
Young, Patrick M. ;
Martinsson, Per-Gunnar .
FRONTIERS OF MATHEMATICS IN CHINA, 2012, 7 (02) :217-247
[14]  
Gittens A, 2016, J MACH LEARN RES, V17
[15]  
Goreinov S. A., 2001, Contemporary Mathematics, V280, P47, DOI DOI 10.1090/CONM/280/4620
[16]   A FAST ALGORITHM FOR PARTICLE SIMULATIONS [J].
GREENGARD, L ;
ROKHLIN, V .
JOURNAL OF COMPUTATIONAL PHYSICS, 1987, 73 (02) :325-348
[17]   Efficient algorithms for computing a strong rank-revealing QR factorization [J].
Gu, M ;
Eisenstat, SC .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1996, 17 (04) :848-869
[18]   SUBSPACE ITERATION RANDOMIZATION AND SINGULAR VALUE PROBLEMS [J].
Gu, M. .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2015, 37 (03) :A1139-A1173
[19]   A DIVIDE-AND-CONQUER ALGORITHM FOR THE BIDIAGONAL SVD [J].
GU, M ;
EISENSTAT, SC .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 1995, 16 (01) :79-92
[20]  
Hackbusch W, 1999, COMPUTING, V62, P89, DOI 10.1007/s006070050015