eRPCA: Robust Principal Component Analysis for Exponential Family Distributions

被引:0
作者
Zheng, Xiaojun [1 ]
Mak, Simon [1 ]
Xie, Liyan [2 ]
Xie, Yao [3 ]
机构
[1] Duke Univ, Dept Stat Sci, Durham, NC 27708 USA
[2] Chinese Univ Hong Kong, Sch Data Sci, Shenzhen, Peoples R China
[3] Georgia Inst Technol, H Milton Stewart Sch Ind & Syst Engn ISyE, Atlanta, GA USA
关键词
anomaly detection; exponential distribution family; matrix decomposition; robust principal component analysis; MATRIX DECOMPOSITION; LOW-RANK; SPARSE;
D O I
10.1002/sam.11670
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Robust principal component analysis (RPCA) is a widely used method for recovering low-rank structure from data matrices corrupted by significant and sparse outliers. These corruptions may arise from occlusions, malicious tampering, or other causes for anomalies, and the joint identification of such corruptions with low-rank background is critical for process monitoring and diagnosis. However, existing RPCA methods and their extensions largely do not account for the underlying probabilistic distribution for the data matrices, which in many applications are known and can be highly non-Gaussian. We thus propose a new method called RPCA for exponential family distributions (e(RPCA)), which can perform the desired decomposition into low-rank and sparse matrices when such a distribution falls within the exponential family. We present a novel alternating direction method of multiplier optimization algorithm for efficient e(RPCA )decomposition, under either its natural or canonical parametrization. The effectiveness of e(RPCA )is then demonstrated in two applications: the first for steel sheet defect detection and the second for crime activity monitoring in the Atlanta metropolitan area.
引用
收藏
页数:20
相关论文
共 43 条
[1]  
[Anonymous], 1999, NUMERICAL OPTIMIZATI, DOI DOI 10.1007/B98874
[2]  
Bertsekas D., CONSTRAINED OPTIMIZA
[3]   Robust foreground detection using block-based RPCA [J].
Biao, Yang ;
Ling, Zou .
OPTIK, 2015, 126 (23) :4586-4590
[4]   Robust PCA via Principal Component Pursuit: A review for a comparative evaluation in video surveillance [J].
Bouwmans, Thierry ;
Zahzah, El Hadi .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2014, 122 :22-34
[5]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[6]  
Boyd Stephen., 2009, Convex optimization, DOI [10.1017/CBO9780511804441, DOI 10.1017/CBO9780511804441]
[7]   A SINGULAR VALUE THRESHOLDING ALGORITHM FOR MATRIX COMPLETION [J].
Cai, Jian-Feng ;
Candes, Emmanuel J. ;
Shen, Zuowei .
SIAM JOURNAL ON OPTIMIZATION, 2010, 20 (04) :1956-1982
[8]   Robust Principal Component Analysis? [J].
Candes, Emmanuel J. ;
Li, Xiaodong ;
Ma, Yi ;
Wright, John .
JOURNAL OF THE ACM, 2011, 58 (03)
[9]   Poisson Matrix Recovery and Completion [J].
Cao, Yang ;
Xie, Yao .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2016, 64 (06) :1609-1620
[10]  
Casella G., 2002, STAT INFERENCE, VSecond