Efficient subspace clustering and feature extraction via l2, 1- norm and l1, 2-norm minimization

被引:4
作者
Qiao, Xiaoguang [1 ]
Chen, Caikou [1 ]
Wang, Weiye [1 ]
机构
[1] Yangzhou Univ, Coll Informat Engn, Yangzhou 225000, Peoples R China
关键词
Subspace clustering; Feature extraction; l(2, 1)-norm and l(1,2)-norm; MOTION SEGMENTATION; FACE RECOGNITION; ALGORITHM;
D O I
10.1016/j.neucom.2024.127813
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The nuclear norm -based Latent Low -Rank Representation (LatLRR) has gained much attention due to its success in subspace clustering and feature extraction. However, it suffers from high computational costs due to the calculation of singular value decomposition for large matrices. To this end, we develop an efficient subspace clustering and feature extraction method (ESCFE) which substitutes the nuclear norm with the l(2, 1) -norm and l(1, 2) -norm respectively. Theoretically proof shows both the l(2, 1 )-norm and l(1, 2)- norm can serve as the convex surrogates of the nuclear norm while can derive closed -form solutions. Furthermore, the l(2, 1) -norm (or l(1, 2)- norm) regularization promotes column (or row) structure sparsity due to the discriminative nature inherited from the l (1) -norm. Thus the proposed ESCFE is robust to outliers in data and can extract features with joint sparsity. Extensive experiments on multiple benchmark datasets demonstrate the superiority of our method in both efficiency and effectiveness.
引用
收藏
页数:10
相关论文
共 50 条
[1]  
Agarwal Pankaj K., 2004, ACM SIGACT SIGMOD SI
[2]  
Basri R, 2001, EIGHTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOL II, PROCEEDINGS, P383, DOI 10.1109/ICCV.2001.937651
[3]   A FAST ITERATIVE SHRINKAGE-THRESHOLDING ALGORITHM WITH APPLICATION TO WAVELET-BASED IMAGE DEBLURRING [J].
Beck, Amir ;
Teboulle, Marc .
2009 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS 1- 8, PROCEEDINGS, 2009, :693-+
[4]  
Bertsekas D. P., 2014, Constrained optimization and Lagrange multiplier methods
[5]  
Boult T. E., 1991, Proceedings of the IEEE Workshop on Visual Motion (Cat. No.91TH0390-5), P179, DOI 10.1109/WVM.1991.212809
[6]   Speed up kernel discriminant analysis [J].
Cai, Deng ;
He, Xiaofei ;
Han, Jiawei .
VLDB JOURNAL, 2011, 20 (01) :21-33
[7]   Graph Regularized Nonnegative Matrix Factorization for Data Representation [J].
Cai, Deng ;
He, Xiaofei ;
Han, Jiawei ;
Huang, Thomas S. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (08) :1548-1560
[8]   Spectral Curvature Clustering (SCC) [J].
Chen, Guangliang ;
Lerman, Gilad .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2009, 81 (03) :317-330
[9]   Robust Subspace Segmentation Via Low-Rank Representation [J].
Chen, Jinhui ;
Yang, Jian .
IEEE TRANSACTIONS ON CYBERNETICS, 2014, 44 (08) :1432-1445
[10]  
Ding C., 2006, P INT C MACH LEARN, P281, DOI DOI 10.1145/1143844.1143880