Inductive Robust Principal Component Analysis

被引:135
作者
Bao, Bing-Kun [1 ,2 ]
Liu, Guangcan [3 ]
Xu, Changsheng [1 ,2 ]
Yan, Shuicheng [4 ]
机构
[1] Chinese Acad Sci, Natl Lab Pattern Recognit, Inst Automat, Beijing 100190, Peoples R China
[2] China Singapore Inst Digital Media, Singapore 119613, Singapore
[3] Univ Illinois, Urbana, IL 61801 USA
[4] Natl Univ Singapore, Singapore 10000, Singapore
基金
中国国家自然科学基金;
关键词
Error correction; robust principal component analysis (PCA); subspace learning; DISPERSION MATRICES; SYSTEMS;
D O I
10.1109/TIP.2012.2192742
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we address the error correction problem, that is, to uncover the low-dimensional subspace structure from high-dimensional observations, which are possibly corrupted by errors. When the errors are of Gaussian distribution, principal component analysis (PCA) can find the optimal (in terms of least-square error) low-rank approximation to high-dimensional data. However, the canonical PCA method is known to be extremely fragile to the presence of gross corruptions. Recently, Wright et al. established a so-called robust principal component analysis (RPCA) method, which can well handle the grossly corrupted data. However, RPCA is a transductive method and does not handle well the new samples, which are not involved in the training procedure. Given a new datum, RPCA essentially needs to recalculate over all the data, resulting in high computational cost. So, RPCA is inappropriate for the applications that require fast online computation. To overcome this limitation, in this paper, we propose an inductive robust principal component analysis (IRPCA) method. Given a set of training data, unlike RPCA that targets on recovering the original data matrix, IRPCA aims at learning the underlying projection matrix, which can be used to efficiently remove the possible corruptions in any datum. The learning is done by solving a nuclear-norm regularized minimization problem, which is convex and can be solved in polynomial time. Extensive experiments on a benchmark human face dataset and two video surveillance datasets show that IRPCA cannot only be robust to gross corruptions, but also handle the new data well and in an efficient way.
引用
收藏
页码:3794 / 3800
页数:7
相关论文
共 30 条
[1]  
[Anonymous], 2010, P 18 ACM INT C MULT
[2]  
[Anonymous], ART DOING SCI ENG LE
[3]  
[Anonymous], J ACM
[4]   ORDERING OF MULTIVARIATE DATA [J].
BARNETT, V .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES A-STATISTICS IN SOCIETY, 1976, 139 :318-354
[5]   Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection [J].
Belhumeur, PN ;
Hespanha, JP ;
Kriegman, DJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (07) :711-720
[6]   A SINGULAR VALUE THRESHOLDING ALGORITHM FOR MATRIX COMPLETION [J].
Cai, Jian-Feng ;
Candes, Emmanuel J. ;
Shen, Zuowei .
SIAM JOURNAL ON OPTIMIZATION, 2010, 20 (04) :1956-1982
[7]  
Candes E. J., 2009, ROBUST PRINCIPAL COM
[8]   Matrix Completion With Noise [J].
Candes, Emmanuel J. ;
Plan, Yaniv .
PROCEEDINGS OF THE IEEE, 2010, 98 (06) :925-936
[9]   Exact Matrix Completion via Convex Optimization [J].
Candes, Emmanuel J. ;
Recht, Benjamin .
FOUNDATIONS OF COMPUTATIONAL MATHEMATICS, 2009, 9 (06) :717-772
[10]   A multibody factorization method for independently moving objects [J].
Costeira, JP ;
Kanade, T .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1998, 29 (03) :159-179