ROBUST LOW-RANK MATRIX COMPLETION BY RIEMANNIAN OPTIMIZATION

被引:51
作者
Cambier, Leopold [1 ]
Absil, P-A. [2 ]
机构
[1] Stanford Univ, Inst Computat & Math Engn, Stanford, CA 94305 USA
[2] Catholic Univ Louvain, ICTEAM Inst, B-1348 Louvain La Neuve, Belgium
关键词
low-rank matrix completion; Riemannian optimization; outliers; smoothing techniques; l(1) norm; nonsmooth; fixed-rank manifold;
D O I
10.1137/15M1025153
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Low-rank matrix completion is the problem where one tries to recover a low-rank matrix from noisy observations of a subset of its entries. In this paper, we propose RMC, a new method to deal with the problem of robust low-rank matrix completion, i.e., matrix completion where a fraction of the observed entries are corrupted by non-Gaussian noise, typically outliers. The method relies on the idea of smoothing the l(1) norm and using Riemannian optimization to deal with the low-rank constraint. We first state the algorithm as the successive minimization of smooth approximations of the l(1) norm, and we analyze its convergence by showing the strict decrease of the objective function. We then perform numerical experiments on synthetic data and demonstrate the effectiveness on the proposed method on the Netflix dataset.
引用
收藏
页码:S440 / S460
页数:21
相关论文
共 32 条
[1]   Low-rank retractions: a survey and new results [J].
Absil, P. -A. ;
Oseledets, I. V. .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2015, 62 (01) :5-29
[2]  
Absil PA, 2008, OPTIMIZATION ALGORITHMS ON MATRIX MANIFOLDS, P1
[3]  
[Anonymous], 2011, Advances in neural information processing systems
[4]  
[Anonymous], 2011, P INT C MACH LEARN
[5]  
[Anonymous], 2007, P KDD CUP WORKSH NEW
[6]  
Balzano L., 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton), P704, DOI 10.1109/ALLERTON.2010.5706976
[7]   Low-rank matrix completion via preconditioned optimization on the Grassmann manifold [J].
Boumal, Nicolas ;
Absil, P. -A. .
LINEAR ALGEBRA AND ITS APPLICATIONS, 2015, 475 :200-239
[8]  
Boumal N, 2014, J MACH LEARN RES, V15, P1455
[9]   Robust Principal Component Analysis? [J].
Candes, Emmanuel J. ;
Li, Xiaodong ;
Ma, Yi ;
Wright, John .
JOURNAL OF THE ACM, 2011, 58 (03)
[10]   Matrix Completion With Noise [J].
Candes, Emmanuel J. ;
Plan, Yaniv .
PROCEEDINGS OF THE IEEE, 2010, 98 (06) :925-936