Robust Principal Component Analysis using Density Power Divergence

被引:0
|
作者
Roy, Subhrajyoty [1 ]
Basu, Ayanendranath [1 ]
Ghosh, Abhik [1 ]
机构
[1] Indian Stat Inst, Interdisciplinary Stat Res Unit, Kolkata 700108, West Bengal, India
关键词
Robust PCA; Eigen Decomposition; Matrix Factorization; Density Power Divergence; Breakdown Point; PROJECTION-PURSUIT APPROACH; DISPERSION MATRICES; OPTIMIZATION; ESTIMATORS; FRAMEWORK; LOCATION; PCA;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Principal component analysis (PCA) is a widely employed statistical tool used primarilyfor dimensionality reduction. However, it is known to be adversely affected by the presenceof outlying observations in the sample, which is quite common. Robust PCA methodsusing M-estimators have theoretical benefits, but their robustness drop substantially forhigh dimensional data. On the other end of the spectrum, robust PCA algorithms solv-ing principal component pursuit or similar optimization problems have high breakdown,but lack theoretical richness and demand high computational power compared to the M-estimators. We introduce a novel robust PCA estimator based on the minimum densitypower divergence estimator. This combines the theoretical strength of the M-estimatorsand the minimum divergence estimators with a high breakdown guarantee regardless ofdata dimension. We present a computationally efficient algorithm for this estimate. Ourtheoretical findings are supported by extensive simulations and comparisons with existingrobust PCA methods. We also showcase the proposed algorithm's applicability on twobenchmark data sets and a credit card transactions data set for fraud detection.
引用
收藏
页数:40
相关论文
共 50 条
  • [1] ROBUST PRINCIPAL COMPONENT ANALYSIS USING ALPHA DIVERGENCE
    Rekavandi, Aref Miri
    Seghouane, Abd-Krim
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 6 - 15
  • [2] Robust Sparse Principal Component Analysis
    Croux, Christophe
    Filzmoser, Peter
    Fritz, Heinrich
    TECHNOMETRICS, 2013, 55 (02) : 202 - 214
  • [3] Robust Bayes estimation using the density power divergence
    Abhik Ghosh
    Ayanendranath Basu
    Annals of the Institute of Statistical Mathematics, 2016, 68 : 413 - 437
  • [4] Robust Bayes estimation using the density power divergence
    Ghosh, Abhik
    Basu, Ayanendranath
    ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2016, 68 (02) : 413 - 437
  • [5] Robust principal component analysis via ES-algorithm
    Lim, Yaeji
    Park, Yeonjoo
    Oh, Hee-Seok
    JOURNAL OF THE KOREAN STATISTICAL SOCIETY, 2014, 43 (01) : 149 - 159
  • [6] Robust kernel principal component analysis and classification
    Debruyne, Michiel
    Verdonck, Tim
    ADVANCES IN DATA ANALYSIS AND CLASSIFICATION, 2010, 4 (2-3) : 151 - 167
  • [7] Exactly Robust Kernel Principal Component Analysis
    Fan, Jicong
    Chow, Tommy W. S.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (03) : 749 - 761
  • [8] ROBUST PRINCIPAL COMPONENT ANALYSIS WITH MATRIX FACTORIZATION
    Chen, Yongyong
    Zhou, Yicong
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 2411 - 2415
  • [9] ROBUST PRINCIPAL COMPONENT ANALYSIS BASED ON TRIMMING AROUND AFFINE SUBSPACES
    Croux, C.
    Garcia-Escudero, L. A.
    Gordaliza, A.
    Ruwet, C.
    San Martin, R.
    STATISTICA SINICA, 2017, 27 (03) : 1437 - 1459
  • [10] Point cloud denoising using robust Principal Component Analysis
    Narvaez, Esmelde A. Leal
    Narvaez, Nallig Eduardo Leal
    GRAPP 2006: PROCEEDINGS OF THE FIRST INTERNATIONAL CONFERENCE ON COMPUTER GRAPHICS THEORY AND APPLICATIONS, 2006, : 51 - +