Robust Principal Component Analysis using Density Power Divergence

被引:0
|
作者
Roy, Subhrajyoty [1 ]
Basu, Ayanendranath [1 ]
Ghosh, Abhik [1 ]
机构
[1] Indian Stat Inst, Interdisciplinary Stat Res Unit, Kolkata 700108, West Bengal, India
关键词
Robust PCA; Eigen Decomposition; Matrix Factorization; Density Power Divergence; Breakdown Point; PROJECTION-PURSUIT APPROACH; DISPERSION MATRICES; OPTIMIZATION; ESTIMATORS; FRAMEWORK; LOCATION; PCA;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Principal component analysis (PCA) is a widely employed statistical tool used primarilyfor dimensionality reduction. However, it is known to be adversely affected by the presenceof outlying observations in the sample, which is quite common. Robust PCA methodsusing M-estimators have theoretical benefits, but their robustness drop substantially forhigh dimensional data. On the other end of the spectrum, robust PCA algorithms solv-ing principal component pursuit or similar optimization problems have high breakdown,but lack theoretical richness and demand high computational power compared to the M-estimators. We introduce a novel robust PCA estimator based on the minimum densitypower divergence estimator. This combines the theoretical strength of the M-estimatorsand the minimum divergence estimators with a high breakdown guarantee regardless ofdata dimension. We present a computationally efficient algorithm for this estimate. Ourtheoretical findings are supported by extensive simulations and comparisons with existingrobust PCA methods. We also showcase the proposed algorithm's applicability on twobenchmark data sets and a credit card transactions data set for fraud detection.
引用
收藏
页数:40
相关论文
共 50 条
  • [31] On robust probabilistic principal component analysis using multivariate t-distributions
    Guo, Yiping
    Bondell, Howard
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2023, 52 (23) : 8261 - 8279
  • [32] Robust adaptive algorithms for fast principal component analysis
    Bekhtaoui, Zineb
    Abed-Meraim, Karim
    Meche, Abdelkrim
    DIGITAL SIGNAL PROCESSING, 2022, 127
  • [33] Robust Principal Component Analysis of Data with Missing Values
    Karkkainen, Tommi
    Saarela, Mirka
    MACHINE LEARNING AND DATA MINING IN PATTERN RECOGNITION, MLDM 2015, 2015, 9166 : 140 - 154
  • [34] ROBUST ADAPTED PRINCIPAL COMPONENT ANALYSIS FOR FACE RECOGNITION
    Chen, Shaokang
    Lovell, Brian C.
    Shan, Ting
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2009, 23 (03) : 491 - 520
  • [35] Accelerated Alternating Projections for Robust Principal Component Analysis
    Cai, HanQin
    Cai, Jian-Feng
    Wei, Ke
    JOURNAL OF MACHINE LEARNING RESEARCH, 2019, 20
  • [36] Algorithms for Projection - Pursuit robust principal component analysis
    Croux, C.
    Filzmoser, P.
    Oliveira, M. R.
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2007, 87 (02) : 218 - 225
  • [37] Robust Principal Component Analysis Based on Discriminant Information
    Gao, Yunlong
    Lin, Tingting
    Zhang, Yisong
    Luo, Sizhe
    Nie, Feiping
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (02) : 1991 - 2003
  • [38] Adaptive Rank Estimate in Robust Principal Component Analysis
    Xu, Zhengqin
    He, Rui
    Xie, Shoulie
    Wu, Shiqian
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 6573 - 6582
  • [39] A comparison of robust principal component analysis in high dimensions
    Liu, Yun
    Shu, Lianjie
    Li, Yanting
    Tian, Guoliang
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2025,
  • [40] Max-Min Robust Principal Component Analysis
    Wang, Sisi
    Nie, Feiping
    Wang, Zheng
    Wang, Rong
    Li, Xuelong
    NEUROCOMPUTING, 2023, 521 : 89 - 98