Exact Guarantees on the Absence of Spurious Local Minima for Non-negative Rank-1 Robust Principal Component Analysis

被引:0
作者
Fattahi, Salar [1 ]
Sojoudi, Somayeh [2 ,3 ]
机构
[1] Univ Calif Berkeley, Dept Ind Engn & Operat Res, Berkeley, CA 94720 USA
[2] Univ Calif Berkeley, Dept Elect Engn & Comp Sci, Berkeley, CA 94720 USA
[3] Univ Calif Berkeley, Dept Mech Engn, Berkeley, CA 94720 USA
关键词
PROGRAMMING ALGORITHM; MATRIX FACTORIZATION; NONCONVEX; OPTIMIZATION; NONSMOOTH;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work is concerned with the non-negative rank-1 robust principal component analysis (RPCA), where the goal is to recover the dominant non-negative principal components of a data matrix precisely, where a number of measurements could be grossly corrupted with sparse and arbitrary large noise. Most of the known techniques for solving the RPCA rely on convex relaxation methods by lifting the problem to a higher dimension, which significantly increase the number of variables. As an alternative, the well-known Burer-Monteiro approach can be used to cast the RPCA as a non-convex and non-smooth '1 optimization problem with a significantly smaller number of variables. In this work, we show that the low-dimensional formulation of the symmetric and asymmetric positive rank-1 RPCA based on the Burer-Monteiro approach has benign landscape, i.e., 1) it does not have any spurious local solution, 2) has a unique global solution, and 3) its unique global solution coincides with the true components. An implication of this result is that simple local search algorithms are guaranteed to achieve a zero global optimality gap when directly applied to the low-dimensional formulation. Furthermore, we provide strong deterministic and probabilistic guarantees for the exact recovery of the true principal components. In particular, it is shown that a constant fraction of the measurements could be grossly corrupted and yet they would not create any spurious local solution.
引用
收藏
页数:51
相关论文
共 59 条
  • [1] [Anonymous], 2008, Principal manifolds for data visualization and dimension reduction, DOI DOI 10.1007/978-3-540-73750-6_5
  • [2] [Anonymous], 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence
  • [3] [Anonymous], 2018, ADV NEURAL INFORM PR
  • [4] [Anonymous], POLYNOMIAL OPTIMIZAT
  • [5] [Anonymous], INT ENCY STAT SCI
  • [6] [Anonymous], 1995, Discrete Mathematics and Applications
  • [7] [Anonymous], 2009, NONNEGATIVE MATRIX T
  • [8] [Anonymous], 2017, No spurious local minima in nonconvex low rank problems
  • [9] [Anonymous], 1959, PUBL MATH-DEBRECEN
  • [10] [Anonymous], 2016, ADV NEURAL INFORM PR