Unified Framework for Faster Clustering via Joint Schatten p-Norm Factorization With Optimal Mean

被引:3
作者
Zhang, Hengmin [1 ,2 ]
Zhao, Jiaoyan [3 ]
Zhang, Bob [1 ,2 ]
Gong, Chen [4 ]
Qian, Jianjun [4 ]
Yang, Jian [4 ]
机构
[1] Univ Macau, Inst Collaborat Innovat, Dept Comp & Informat Sci, PAMI Res Grp, Macau, Peoples R China
[2] Univ Macau, Inst Collaborat Innovat, Ctr Artificial Intelligence & Robot, Macau, Peoples R China
[3] Shenzhen Polytech Univ, Sch Artificial Intelligence, Shenzhen 518055, Peoples R China
[4] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Key Lab Intelligent Percept & Syst & High Dimens I, PCA Lab,Minist Educ, Nanjing 210094, Peoples R China
基金
中国博士后科学基金;
关键词
Optimization; Computational complexity; Clustering algorithms; Minimization; Convergence; Computational modeling; Learning systems; Low-rank representation (LRR); matrix factorization; optimal mean; Schatten p-norm; subspace clustering; MATRIX COMPLETION; RANK; NONCONVEX; SUBSPACE; MINIMIZATION; ALGORITHM; CONVERGENCE;
D O I
10.1109/TNNLS.2023.3327716
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To enhance the effectiveness and efficiency of subspace clustering in visual tasks, this work introduces a novel approach that automatically eliminates the optimal mean, which is embedded in the subspace clustering framework of low-rank representation (LRR) methods, along with the computationally factored formulation of Schatten p-norm. By addressing the issues related to meaningful computations involved in some LRR methods and overcoming biased estimation of the low-rank solver, we propose faster nonconvex subspace clustering methods through joint Schatten p-norm factorization with optimal mean (JSpNFOM), forming a unified framework for enhancing performance while reducing time consumption. The proposed approach employs tractable and scalable factor techniques, which effectively address the disadvantages of higher computational complexity, particularly when dealing with large-scale coefficient matrices. The resulting nonconvex minimization problems are reformulated and further iteratively optimized by multivariate weighting algorithms, eliminating the need for singular value decomposition (SVD) computations in the developed iteration procedures. Moreover, each subproblem can be guaranteed to obtain the closed-form solver, respectively. The theoretical analyses of convergence properties and computational complexity further support the applicability of the proposed methods in real-world scenarios. Finally, comprehensive experimental results demonstrate the effectiveness and efficiency of the proposed nonconvex clustering approaches compared to existing state-of-the-art methods on several publicly available databases. The demonstrated improvements highlight the practical significance of our work in subspace clustering tasks for visual data analysis. The source code for the proposed algorithms is publicly accessible at https://github.com/ZhangHengMin/TRANSUFFC.
引用
收藏
页码:3012 / 3026
页数:15
相关论文
共 64 条
[1]   Ensemble Joint Sparse Low-Rank Matrix Decomposition for Thermography Diagnosis System [J].
Ahmed, Junaid ;
Gao, Bin ;
Woo, Wai Lok ;
Zhu, Yuyu .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (03) :2648-2658
[2]  
[Anonymous], 2011, Adv Neural Inf Process Syst, DOI DOI 10.48550/ARXIV.1109.0367
[3]  
[Anonymous], 2012, P 26 AAAI C ART INT
[4]   Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Lojasiewicz Inequality [J].
Attouch, Hedy ;
Bolte, Jerome ;
Redont, Patrick ;
Soubeyran, Antoine .
MATHEMATICS OF OPERATIONS RESEARCH, 2010, 35 (02) :438-457
[5]   Proximal alternating linearized minimization for nonconvex and nonsmooth problems [J].
Bolte, Jerome ;
Sabach, Shoham ;
Teboulle, Marc .
MATHEMATICAL PROGRAMMING, 2014, 146 (1-2) :459-494
[6]   Decomposition into low-rank plus additive matrices for background/foreground separation: A review for a comparative evaluation with a large-scale dataset [J].
Bouwmans, Thierry ;
Sobral, Andrews ;
Javed, Sajid ;
Jung, Soon Ki ;
Zahzah, El-Hadi .
COMPUTER SCIENCE REVIEW, 2017, 23 :1-71
[7]  
Boyd S., 2011, FOUND TRENDS MACH LE, V3, P1, DOI DOI 10.1561/2200000016
[8]   l0-Motivated Low-Rank Sparse Subspace Clustering [J].
Brbic, Maria ;
Kopriva, Ivica .
IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (04) :1711-1725
[9]   A SINGULAR VALUE THRESHOLDING ALGORITHM FOR MATRIX COMPLETION [J].
Cai, Jian-Feng ;
Candes, Emmanuel J. ;
Shen, Zuowei .
SIAM JOURNAL ON OPTIMIZATION, 2010, 20 (04) :1956-1982
[10]   Robust Principal Component Analysis? [J].
Candes, Emmanuel J. ;
Li, Xiaodong ;
Ma, Yi ;
Wright, John .
JOURNAL OF THE ACM, 2011, 58 (03)