ROBUST LOW-RANK MATRIX ESTIMATION

被引:35
作者
Elsener, Andreas [1 ]
van de Geer, Sara [1 ]
机构
[1] Swiss Fed Inst Technol, Seminar Stat, CH-8092 Zurich, Switzerland
关键词
Matrix completion; robustness; empirical risk minimization; oracle inequality; nuclear norm; sparsity; COMPLETION; NORM;
D O I
10.1214/17-AOS1666
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Many results have been proved for various nuclear norm penalized estimators of the uniform sampling matrix completion problem. However, most of these estimators are not robust: in most of the cases the quadratic loss function and its modifications are used. We consider robust nuclear norm penalized estimators using two well-known robust loss functions: the absolute value loss and the Huber loss. Under several conditions on the sparsity of the problem (i.e., the rank of the parameter matrix) and on the regularity of the risk function sharp and nonsharp oracle inequalities for these estimators are shown to hold with high probability. As a consequence, the asymptotic behavior of the estimators is derived Similar error bounds are obtained under the assumption of weak sparsity, that is, the case where the matrix is assumed to be only approximately low-rank. In all of our results, we consider a high dimensional setting. In this case, this means that we assume n <= pq. Finally, various simulations confirm our theoretical results.
引用
收藏
页码:3481 / 3509
页数:29
相关论文
共 23 条
[1]  
[Anonymous], 2011, Advances in Neural Information Processing Systems
[2]  
[Anonymous], NEARLY OPTIMAL ROBUS
[3]  
[Anonymous], 2004, P ADV NEUR INF PROC
[4]  
Bühlmann P, 2011, SPRINGER SER STAT, P1, DOI 10.1007/978-3-642-20192-9
[5]   ROBUST LOW-RANK MATRIX COMPLETION BY RIEMANNIAN OPTIMIZATION [J].
Cambier, Leopold ;
Absil, P-A. .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2016, 38 (05) :S440-S460
[6]   Robust Principal Component Analysis? [J].
Candes, Emmanuel J. ;
Li, Xiaodong ;
Ma, Yi ;
Wright, John .
JOURNAL OF THE ACM, 2011, 58 (03)
[7]   Matrix Completion With Noise [J].
Candes, Emmanuel J. ;
Plan, Yaniv .
PROCEEDINGS OF THE IEEE, 2010, 98 (06) :925-936
[8]   RANK-SPARSITY INCOHERENCE FOR MATRIX DECOMPOSITION [J].
Chandrasekaran, Venkat ;
Sanghavi, Sujay ;
Parrilo, Pablo A. ;
Willsky, Alan S. .
SIAM JOURNAL ON OPTIMIZATION, 2011, 21 (02) :572-596
[9]   Low-Rank Matrix Recovery From Errors and Erasures [J].
Chen, Yudong ;
Jalali, Ali ;
Sanghavi, Sujay ;
Caramanis, Constantine .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2013, 59 (07) :4324-4337
[10]  
CVX Research Inc, 2012, CVX: Matlab software for disciplined convex programming