<italic>l</italic><sub>2,<italic>p</italic></sub>-Norm Based Discriminant Subspace Clustering Algorithm

被引:0
作者
Zhi, Xiaobin [1 ]
Bi, Longtao [2 ]
Fan, Jiulun [2 ]
机构
[1] Xian Univ Posts & Telecommun, Sch Sci, Xian 710121, Peoples R China
[2] Xian Univ Posts & Telecommun, Sch Commun & Informat Engn, Xian 710121, Peoples R China
基金
美国国家科学基金会;
关键词
Clustering algorithms; Feature extraction; Dimensionality reduction; Linear discriminant analysis; Robustness; Telecommunications; Linear regression; Subspace clustering; linear discriminant analysis; < italic xmlns:ali="http:; www; niso; org; schemas; ali; 1; 0; xmlns:mml="http:; w3; 1998; Math; MathML" xmlns:xlink="http:; 1999; xlink" xmlns:xsi="http:; 2001; XMLSchema-instance"> l <; italic > 2; XMLSchema-instance">?<; italic >-norm; iterative reweighted least squares; robustness; FEATURE-EXTRACTION; FRAMEWORK; EFFICIENT; SELECTION;
D O I
10.1109/ACCESS.2020.2988821
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Discriminative subspace clustering (DSC) combines Linear Discriminant Analysis (LDA) with clustering algorithm, such as K-means (KM), to form a single framework to perform dimension reduction and clustering simultaneously. It has been verified to be effective for high-dimensional data. However, most existing DSC algorithms rigidly use the Frobenius norm (F-norm) to define model that may not always suitable for the given data. In this paper, DSC is extended in the sense of -norm, which is a general form of the F-norm, to obtain a family of DSC algorithms which provide more alternative models for practical applications. In order to achieve this goal. Firstly, an efficient algorithm for the -norm based KM (KM clustering is proposed. Then, based on the equivalence of LDA and linear regression, a -norm based LDA LDA) is proposed, and an efficient Iteratively Reweighted Least Squares algorithm for-LDA is presented. Finally, KMp and -LDA are combined into a single framework to form an efficient generalized DSC algorithm: -norm based DSC clustering -DSC). In addition, the effects of the parameters on the proposed algorithm are analyzed, and based on the theory of robust statistics, a special case of -DSC, which can show better robustness on the data sets with noise and outlier, is studied. Extensive experiments are performed to verify the effectiveness of our proposed algorithm.
引用
收藏
页码:76043 / 76055
页数:13
相关论文
共 51 条
[1]  
[Anonymous], PRINCIPAL COMPONENT
[2]  
[Anonymous], 2011, Robust statistics
[3]  
[Anonymous], 2018, Robust Statistics: Theory and Methods
[4]  
[Anonymous], 2007, NIPS
[5]  
[Anonymous], 2007, P 24 INT C MACH LEAR
[6]  
[Anonymous], 2005, Advances in Neural Information Processing Systems
[7]  
[Anonymous], 1998, UCI REPOSITORY MACHI
[8]  
[Anonymous], 2009, Finding Groups in Data: An Introduction to Cluster Analysis
[9]   Laplacian eigenmaps for dimensionality reduction and data representation [J].
Belkin, M ;
Niyogi, P .
NEURAL COMPUTATION, 2003, 15 (06) :1373-1396
[10]   Simultaneous model-based clustering and visualization in the Fisher discriminative subspace [J].
Bouveyron, Charles ;
Brunet, Camille .
STATISTICS AND COMPUTING, 2012, 22 (01) :301-324