L2,1-norm-based sparse principle component analysis with trace norm regularised term

被引:2
作者
Chen, Xiuhong [1 ,2 ]
Sun, Huiqiang [1 ]
机构
[1] Jiangnan Univ, Sch Digital Media, Wuxi, Jiangsu, Peoples R China
[2] Jiangnan Univ, Jiangsu Key Lab Media Design & Software Technol, Wuxi, Jiangsu, Peoples R China
关键词
optimisation; learning (artificial intelligence); principal component analysis; image reconstruction; norm-based sparse PCA; trace norm regularised term; optimal projection matrix; norm-based reconstruction error; trace-norm-based regularised term; sample matrix; training samples; norm-based sparse principle component analysis; widely used unsupervised dimensionality reduction approach; squared reconstruction errors; norm regularisation; MODEL SELECTION; CONSISTENCY; LASSO;
D O I
10.1049/iet-ipr.2018.5433
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Principal component analysis (PCA) is the most widely used unsupervised dimensionality reduction approach. However, most PCA based on the squared reconstruction errors assume that all training samples have been centred, which make them not robust to outliers or noises in the samples and will depress their performance of classification accuracy. On the other hand, when there are various correlations in the training samples, the l(1)-norm regularisation encounters instability problems. To address the above problems, the authors propose a novel L-2,L-1-norm-based sparse PCA with the trace norm regularised term (abbreviated to OMSPCA-L21-TN) to learn the optimal projection matrix and optimal mean simultaneously, where the objective function in model consists of the L-2,L-1-norm-based reconstruction error and the trace-norm-based regularised term of the projection vectors involved the sample matrix. Thus, not only can the authors' method obtain the sparse features and reduce the effect of noise and outliers but also be adaptive to the correlation of the training samples. An effective optimisation solution is also given. The experimental results on some publicly available datasets demonstrate that the proposed approach is feasible and effective.
引用
收藏
页码:910 / 922
页数:13
相关论文
共 30 条
  • [1] [Anonymous], 2011, P 22 INT JOINT C ART
  • [2] [Anonymous], 2013, MATRIX COMPUTATIONS
  • [3] [Anonymous], 2006, J ROYAL STAT SOC B
  • [4] [Anonymous], 2011, P ADV NEUR INF PROC
  • [5] [Anonymous], 2008, P 25 INT C MACHINE L
  • [6] [Anonymous], 2014 IEEE INT C MULT
  • [7] Argyriou A., 2006, ADV NEURAL INFORM PR, P19
  • [8] Bach FR, 2008, J MACH LEARN RES, V9, P1179
  • [9] SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR
    Bickel, Peter J.
    Ritov, Ya'acov
    Tsybakov, Alexandre B.
    [J]. ANNALS OF STATISTICS, 2009, 37 (04) : 1705 - 1732
  • [10] A pure L1-norm principal component analysis
    Brooks, J. P.
    Dula, J. H.
    Boone, E. L.
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2013, 61 : 83 - 98