IMPROVED MATRIX ALGORITHMS VIA THE SUBSAMPLED RANDOMIZED HADAMARD TRANSFORM

被引:77
作者
Boutsidis, Christos [1 ]
Gittens, Alex [2 ]
机构
[1] IBM TJ Watson Res Ctr, Dept Math Sci, Yorktown Hts, NY 10598 USA
[2] CALTECH, Appl & Computat Math Dept, Pasadena, CA 91125 USA
关键词
low-rank approximation; least-squares regression; Hadamard transform; sampling; randomized algorithms; MONTE-CARLO ALGORITHMS; LOW-RANK APPROXIMATION;
D O I
10.1137/120874540
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Several recent randomized linear algebra algorithms rely upon fast dimension reduction methods. A popular choice is the subsampled randomized Hadamard transform (SRHT). In this article, we address the efficacy, in the Frobenius and spectral norms, of an SRHT-based low-rank matrix approximation technique introduced by Woolfe, Liberty, Rohklin, and Tygert. We establish a slightly better Frobenius norm error bound than is currently available, and a much sharper spectral norm error bound (in the presence of reasonable decay of the singular values). Along the way, we produce several results on matrix operations with SRHTs (such as approximate matrix multiplication) that may be of independent interest. Our approach builds upon Tropp's in "Improved Analysis of the Subsampled Randomized Hadamard Transform" [Adv. Adaptive Data Anal., 3 (2011), pp. 115-126].
引用
收藏
页码:1301 / 1340
页数:40
相关论文
共 43 条
[1]  
Ailon N., 2006, P ACM S THEOR COMP S
[2]  
Ailon N, 2008, PROCEEDINGS OF THE NINETEENTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, P1
[3]  
[Anonymous], 2010, ARXIV10012738
[4]   BLENDENPIK: SUPERCHARGING LAPACK'S LEAST-SQUARES SOLVER [J].
Avron, Haim ;
Maymounkov, Petar ;
Toledo, Sivan .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2010, 32 (03) :1217-1236
[5]  
Boutsidis C., 2011, P IEEE S FDN COMP SC
[6]  
Boutsidis C., 2012, ARXIV12023505
[7]  
Boutsidis C., 2010, P C NEUR INF PROC SY
[8]  
Boutsidis C., 2011, THESIS RENSSELAER PO
[9]  
Boutsidis C, 2009, PROCEEDINGS OF THE TWENTIETH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, P968
[10]   Random projections for the nonnegative least-squares problem [J].
Boutsidis, Christos ;
Drineas, Petros .
LINEAR ALGEBRA AND ITS APPLICATIONS, 2009, 431 (5-7) :760-771