Spectrum-Adapted Polynomial Approximation for Matrix Functions with Applications in Graph Signal Processing

被引:3
作者
Fan, Tiffany [1 ]
Shuman, David I. [2 ]
Ubaru, Shashanka [3 ]
Saad, Yousef [4 ]
机构
[1] Stanford Univ, Inst Computat & Math Engn, Stanford, CA 94305 USA
[2] Macalester Coll, Dept Math Stat & Comp Sci, St Paul, MN 55105 USA
[3] IBM TJ Watson Res Ctr, Yorktown Hts, NY 10598 USA
[4] Univ Minnesota, Dept Comp Sci & Engn, Minneapolis, MN 55455 USA
关键词
matrix function; spectral density estimation; polynomial approximation; orthogonal polynomials; graph spectral filtering; weighted least squares polynomial regression; KRYLOV SUBSPACE METHOD; DENSITIES; STATES; RECONSTRUCTION; REGULARIZATION; FRAMEWORK; SYSTEMS; DESIGN;
D O I
10.3390/a13110295
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose and investigate two new methods to approximate f(A)b for large, sparse, Hermitian matrices A. Computations of this form play an important role in numerous signal processing and machine learning tasks. The main idea behind both methods is to first estimate the spectral density of A, and then find polynomials of a fixed order that better approximate the function f on areas of the spectrum with a higher density of eigenvalues. Compared to state-of-the-art methods such as the Lanczos method and truncated Chebyshev expansion, the proposed methods tend to provide more accurate approximations of f(A)b at lower polynomial orders, and for matrices A with a large number of distinct interior eigenvalues and a small spectral width. We also explore the application of these techniques to (i) fast estimation of the norms of localized graph spectral filter dictionary atoms, and (ii) fast filtering of time-vertex signals.
引用
收藏
页码:1 / 22
页数:22
相关论文
共 67 条
[1]   Implementation of a restarted Krylov subspace method for the evaluation of matrix functions [J].
Afanasjew, Martin ;
Eiermann, Michael ;
Ernst, Oliver G. ;
Guettel, Stefan .
LINEAR ALGEBRA AND ITS APPLICATIONS, 2008, 429 (10) :2293-2314
[2]  
[Anonymous], 2013, Matrix Computations
[3]  
[Anonymous], 2008, FUNCTIONS MATRICES
[4]  
[Anonymous], 2012, Topics in Random Matrix Theory
[5]  
[Anonymous], 2010, Discrete Calculus
[6]  
[Anonymous], 2014, Foundations and Trends in Theoretical Computer Science
[7]  
[Anonymous], 2016, INT C MACH LEARN P M
[8]   A Combinatorial, Primal-Dual Approach to Semidefinite Programs [J].
Arora, Sanjeev ;
Kale, Satyen .
STOC 07: PROCEEDINGS OF THE 39TH ANNUAL ACM SYMPOSIUM ON THEORY OF COMPUTING, 2007, :227-236
[9]   An estimator for the diagonal of a matrix [J].
Bekas, C. ;
Kokiopoulou, E. ;
Saad, Y. .
APPLIED NUMERICAL MATHEMATICS, 2007, 57 (11-12) :1214-1229
[10]   Regularization and semi-supervised learning on large graphs [J].
Belkin, M ;
Matveeva, I ;
Niyogi, P .
LEARNING THEORY, PROCEEDINGS, 2004, 3120 :624-638