ANALYTICAL LOW-RANK COMPRESSION VIA PROXY POINT SELECTION

被引:12
作者
Ye, Xin [1 ]
Xia, Jianlin [1 ]
Ying, Lexing [2 ,3 ]
机构
[1] Purdue Univ, Dept Math, W Lafayette, IN 47907 USA
[2] Stanford Univ, Dept Math, Stanford, CA 94305 USA
[3] Stanford Univ, Inst Computat & Math Engn, Stanford, CA 94305 USA
基金
美国国家科学基金会;
关键词
kernel matrix; proxy point method; low-rank approximation; approximation error analysis; hybrid compression; strong rank-revealing factorization; FAST MULTIPOLE METHOD; FAST DIRECT SOLVER; LINEAR-SYSTEMS; FAST ALGORITHM; NYSTROM METHOD; MATRIX; APPROXIMATION; RANDOMIZATION; FACTORIZATION; EIGENSOLVER;
D O I
10.1137/19M1247838
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
It has been known in potential theory that, for some kernel matrices corresponding to well-separated point sets, fast analytical low-rank approximation can be achieved via the use of proxy points. This proxy point method gives a surprisingly convenient way of explicitly writing out approximate basis matrices for a kernel matrix. However, this elegant strategy is rarely known or used in the numerical linear algebra community. It still needs clear algebraic understanding of the theoretical background. Moreover, rigorous quantifications of the approximation errors and reliable criteria for the selection of the proxy points are still missing. In this work, we use contour integration to clearly justify the idea in terms of a class of important kernels. We further provide comprehensive accuracy analysis for the analytical compression and show how to choose nearly optimal proxy points. The analytical compression is then combined with fast rank-revealing factorizations to get compact low-rank approximations and also to select certain representative points. We provide the error bounds for the resulting overall low-rank approximation. This work thus gives a fast and reliable strategy for compressing those kernel matrices. Furthermore, it provides an intuitive way of understanding the proxy point method and bridges the gap between this useful analytical strategy and practical low-rank approximations. Some numerical examples help to further illustrate the ideas.
引用
收藏
页码:1059 / 1085
页数:27
相关论文
共 56 条
[1]   AN IMPLEMENTATION OF THE FAST MULTIPOLE METHOD WITHOUT MULTIPOLES [J].
ANDERSON, CR .
SIAM JOURNAL ON SCIENTIFIC AND STATISTICAL COMPUTING, 1992, 13 (04) :923-947
[2]  
[Anonymous], 2003, Complex analysis
[3]  
[Anonymous], 2008, P 25 INT C MACH LEAR, DOI DOI 10.1145/1390156.1390311
[4]  
CAI D., 2020, SIAM J MATRIX ANAL A
[5]  
Chan R. H., 2016, PREPRINT
[6]   A fast ULV decomposition solver for hierarchically semiseparable representations [J].
Chandrasekaran, S. ;
Gu, M. ;
Pals, T. .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2006, 28 (03) :603-622
[7]   A superfast algorithm for toeplitz systems of linear equations [J].
Chandrasekaran, S. ;
Gu, M. ;
Sun, X. ;
Xia, J. ;
Zhu, J. .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2007, 29 (04) :1247-1266
[8]   On the compression of low rank matrices [J].
Cheng, H ;
Gimbutas, Z ;
Martinsson, PG ;
Rokhlin, V .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2005, 26 (04) :1389-1404
[9]  
Drineas P, 2005, J MACH LEARN RES, V6, P2153
[10]   THE APPROXIMATION OF ONE MATRIX BY ANOTHER OF LOWER RANK [J].
Eckart, Carl ;
Young, Gale .
PSYCHOMETRIKA, 1936, 1 (03) :211-218