Robust Principal Component Pursuit via Inexact Alternating Minimization on Matrix Manifolds

被引:18
作者
Hintermueller, Michael [1 ]
Wu, Tao [2 ]
机构
[1] Humboldt Univ, Dept Math, D-10099 Berlin, Germany
[2] Karl Franzens Univ Graz, Inst Math & Sci Comp, A-8010 Graz, Austria
基金
奥地利科学基金会;
关键词
Matrix decomposition; Low-rank matrix; Sparse matrix; Image processing; Alternating minimization; Riemannian manifold; Optimization on manifolds; LOW-RANK; COMPLETION; SPARSE;
D O I
10.1007/s10851-014-0527-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Robust principal component pursuit (RPCP) refers to a decomposition of a data matrix into a low-rank component and a sparse component. In this work, instead of invoking a convex-relaxation model based on the nuclear norm and the -norm as is typically done in this context, RPCP is solved by considering a least-squares problem subject to rank and cardinality constraints. An inexact alternating minimization scheme, with guaranteed global convergence, is employed to solve the resulting constrained minimization problem. In particular, the low-rank matrix subproblem is resolved inexactly by a tailored Riemannian optimization technique, which favorably avoids singular value decompositions in full dimension. For the overall method, a corresponding -linear convergence theory is established. The numerical experiments show that the newly proposed method compares competitively with a popular convex-relaxation based approach.
引用
收藏
页码:361 / 377
页数:17
相关论文
共 31 条
  • [1] PROJECTION-LIKE RETRACTIONS ON MATRIX MANIFOLDS
    Absil, P. -A.
    Malick, Jerome
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2012, 22 (01) : 135 - 158
  • [2] Absil PA, 2008, OPTIMIZATION ALGORITHMS ON MATRIX MANIFOLDS, P1
  • [3] [Anonymous], 1997, NUMERICAL LINEAR ALG
  • [4] [Anonymous], 2012, Adv. Neural Inform. Processing Systems
  • [5] [Anonymous], SORTING SEARCHING AR
  • [6] [Anonymous], 2011, Advances in neural information processing systems
  • [7] [Anonymous], 1984, Multivariate Observations, DOI DOI 10.1002/9780470316641
  • [8] Boumal N, 2014, J MACH LEARN RES, V15, P1455
  • [9] A SINGULAR VALUE THRESHOLDING ALGORITHM FOR MATRIX COMPLETION
    Cai, Jian-Feng
    Candes, Emmanuel J.
    Shen, Zuowei
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2010, 20 (04) : 1956 - 1982
  • [10] Robust Principal Component Analysis?
    Candes, Emmanuel J.
    Li, Xiaodong
    Ma, Yi
    Wright, John
    [J]. JOURNAL OF THE ACM, 2011, 58 (03)