LOW-RANK MATRIX RECOVERY VIA ITERATIVELY REWEIGHTED LEAST SQUARES MINIMIZATION

被引:170
作者
Fornasier, Massimo [1 ]
Rauhut, Holger [2 ,3 ]
Ward, Rachel [4 ]
机构
[1] Austrian Acad Sci, Johann Radon Inst Computat & Appl Math, A-4040 Linz, Austria
[2] Univ Bonn, Hausdorff Ctr Math, D-53115 Bonn, Germany
[3] Univ Bonn, Inst Numer Simulat, D-53115 Bonn, Germany
[4] NYU, Courant Inst Math Sci, Dept Math, New York, NY 10012 USA
基金
美国国家科学基金会;
关键词
low-rank matrix recovery; iteratively reweighted least squares; matrix completion; COMPLETION; EQUATIONS; VALUES;
D O I
10.1137/100811404
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We present and analyze an efficient implementation of an iteratively reweighted least squares algorithm for recovering a matrix from a small number of linear measurements. The algorithm is designed for the simultaneous promotion of both a minimal nuclear norm and an approximately low-rank solution. Under the assumption that the linear measurements fulfill a suitable generalization of the null space property known in the context of compressed sensing, the algorithm is guaranteed to recover iteratively any matrix with an error of the order of the best k-rank approximation. In certain relevant cases, for instance, for the matrix completion problem, our version of this algorithm can take advantage of the Woodbury matrix identity, which allows us to expedite the solution of the least squares problems required at each iteration. We present numerical experiments which confirm the robustness of the algorithm for the solution of matrix completion problems, and we demonstrate its competitiveness with respect to other techniques proposed recently in the literature.
引用
收藏
页码:1614 / 1640
页数:27
相关论文
共 36 条
[1]  
Ailon N, 2011, PROCEEDINGS OF THE TWENTY-SECOND ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, P185
[2]  
[Anonymous], 2010, Theoretical foundations and numerical methods for sparse recovery, DOI DOI 10.1515/9783110226157.1
[3]  
Boyd S., 2004, CONVEX OPTIMIZATION, VFirst, DOI DOI 10.1017/CBO9780511804441
[4]   A SINGULAR VALUE THRESHOLDING ALGORITHM FOR MATRIX COMPLETION [J].
Cai, Jian-Feng ;
Candes, Emmanuel J. ;
Shen, Zuowei .
SIAM JOURNAL ON OPTIMIZATION, 2010, 20 (04) :1956-1982
[5]   Tight Oracle Inequalities for Low-Rank Matrix Recovery From a Minimal Number of Noisy Random Measurements [J].
Candes, Emmanuel J. ;
Plan, Yaniv .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2011, 57 (04) :2342-2359
[6]   The Power of Convex Relaxation: Near-Optimal Matrix Completion [J].
Candes, Emmanuel J. ;
Tao, Terence .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2010, 56 (05) :2053-2080
[7]   Exact Matrix Completion via Convex Optimization [J].
Candes, Emmanuel J. ;
Recht, Benjamin .
FOUNDATIONS OF COMPUTATIONAL MATHEMATICS, 2009, 9 (06) :717-772
[8]   Image recovery via total variation minimization and related problems [J].
Chambolle, A ;
Lions, PL .
NUMERISCHE MATHEMATIK, 1997, 76 (02) :167-188
[9]  
Cohen A, 2009, J AM MATH SOC, V22, P211
[10]   Iteratively Reweighted Least Squares Minimization for Sparse Recovery [J].
Daubechies, Ingrid ;
Devore, Ronald ;
Fornasier, Massimo ;
Guentuerk, C. Sinan .
COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 2010, 63 (01) :1-38