STRUCTURAL CONVERGENCE RESULTS FOR APPROXIMATION OF DOMINANT SUBSPACES FROM BLOCK KRYLOV SPACES

被引:25
作者
Drineas, Petros [1 ]
Ipsen, Ilse C. F. [2 ]
Kontopoulou, Eugenia-Maria [1 ]
Magdon-Ismail, Malik [3 ]
机构
[1] Purdue Univ, Dept Comp Sci, W Lafayette, IN 47907 USA
[2] North Carolina State Univ, Dept Math, Raleigh, NC 27695 USA
[3] Rensselaer Polytech Inst, Dept Comp Sci, Troy, NY 12180 USA
关键词
singular value decomposition; least squares; principal angles; gap-amplifying polynomials; random matrices; EXTREMAL EIGENVALUES; LANCZOS; ALGORITHMS; BOUNDS;
D O I
10.1137/16M1091745
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper is concerned with approximating the dominant left singular vector space of a real matrix A of arbitrary dimension, from block Krylov spaces generated by the matrix AA(T) and the block vector AX. Two classes of results are presented. First are bounds on the distance, in the two- and Frobenius norms, between the Krylov space and the target space. The distance is expressed in terms of principal angles. Second are bounds for the low-rank approximation computed from the Krylov space compared to the best low-rank approximation, in the two- and Frobenius norms. For starting guesses X of full column-rank, the bounds depend on the tangent of the principal angles between X and the dominant right singular vector space of A. The results presented here form the structural foundation for the analysis of randomized Krylov space methods. The innovative feature is a combination of traditional Lanczos convergence analysis with optimal approximations via least squares problems.
引用
收藏
页码:567 / 586
页数:20
相关论文
共 45 条
[21]   ESTIMATING EXTREMAL EIGENVALUES AND CONDITION NUMBERS OF MATRICES [J].
DIXON, JD .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 1983, 20 (04) :812-814
[22]   RELATIVE-ERROR CU R MATRIX DECOMPOSITIONS [J].
Drineas, Petros ;
Mahoney, Michael W. ;
Muthukrishnan, S. .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2008, 30 (02) :844-881
[23]   RandNLA: Randomized Numerical Linear Algebra [J].
Drineas, Petros ;
Mahoney, Michael W. .
COMMUNICATIONS OF THE ACM, 2016, 59 (06) :80-90
[24]   Faster least squares approximation [J].
Drineas, Petros ;
Mahoney, Michael W. ;
Muthukrishnan, S. ;
Sarlos, Tamas .
NUMERISCHE MATHEMATIK, 2011, 117 (02) :219-249
[25]   On relative residual bounds for the Eigenvalues of a Hermitian matrix [J].
Drmac, Z .
LINEAR ALGEBRA AND ITS APPLICATIONS, 1996, 244 :155-163
[26]   SUBSPACE ITERATION RANDOMIZATION AND SINGULAR VALUE PROBLEMS [J].
Gu, M. .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2015, 37 (03) :A1139-A1173
[27]   Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix Decompositions [J].
Halko, N. ;
Martinsson, P. G. ;
Tropp, J. A. .
SIAM REVIEW, 2011, 53 (02) :217-288
[28]  
Hawkins J. B., 1973, Linear and Multilinear Algebra, V1, P163
[29]  
Horn RA, 1994, Topics in Matrix Analysis
[30]   IMPROVING THE ACCURACY OF INVERSE ITERATION [J].
JESSUP, ER ;
IPSEN, ICF .
SIAM JOURNAL ON SCIENTIFIC AND STATISTICAL COMPUTING, 1992, 13 (02) :550-572