Matrix completion via max-norm constrained optimization

被引:51
作者
Cai, T. Tony [1 ]
Zhou, Wen-Xin [2 ]
机构
[1] Univ Penn, Wharton Sch, Dept Stat, Philadelphia, PA 19104 USA
[2] Princeton Univ, Dept Operat Res & Financial Engn, Princeton, NJ 08544 USA
关键词
Compressed sensing; low-rank matrix; matrix completion; max-norm constrained minimization; minimax optimality; non-uniform sampling; sparsity; LOW-RANK MATRIX; PENALIZATION; INEQUALITIES; RATES;
D O I
10.1214/16-EJS1147
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Matrix completion has been well studied under the uniform sampling model and the trace-norm regularized methods perform well both theoretically and numerically in such a setting. However, the uniform sampling model is unrealistic for a range of applications and the standard trace-norm relaxation can behave very poorly when the underlying sampling scheme is non-uniform. In this paper we propose and analyze a max-norm constrained empirical risk minimization method for noisy matrix completion under a general sampling model. The optimal rate of convergence is established under the Frobenius norm loss in the context of approximately low-rank matrix reconstruction. It is shown that the max-norm constrained method is minimax rate-optimal and yields a unified and robust approximate recovery guarantee, with respect to the sampling distributions. The computational effectiveness of this method is also discussed, based on first-order algorithms for solving convex optimizations involving max-norm regularization.
引用
收藏
页码:1493 / 1525
页数:33
相关论文
共 50 条
[1]  
[Anonymous], 2010, Advances in Neural Information Processing Systems
[2]  
[Anonymous], 1991, Probability in Banach Spaces
[3]  
[Anonymous], 2011, Advances in Neural Information Processing Systems
[4]  
[Anonymous], 2011, JMLR WORKSHOP C P
[5]  
[Anonymous], 2004, P ADV NEUR INF PROC
[6]  
[Anonymous], 2010, Advances in Neural Information Processing Systems (NeurIPS)
[7]   Convex multi-task feature learning [J].
Argyriou, Andreas ;
Evgeniou, Theodoros ;
Pontil, Massimiliano .
MACHINE LEARNING, 2008, 73 (03) :243-272
[8]  
Assouad B. Yu., 1997, Festschrift for Lucien Le Cam, P423
[9]  
Bartlett P. L., 2003, Journal of Machine Learning Research, V3, P463, DOI 10.1162/153244303321897690
[10]  
Bousquet O, 2003, PROG PROBAB, V56, P213