Generalized Nonconvex Low-Rank Tensor Approximation for Multi-View Subspace Clustering

被引:148
作者
Chen, Yongyong [1 ,2 ,3 ]
Wang, Shuqin [4 ]
Peng, Chong [5 ]
Hua, Zhongyun [1 ]
Zhou, Yicong [6 ]
机构
[1] Harbin Inst Technol Shenzhen, Sch Comp Sci & Technol, Shenzhen 518055, Peoples R China
[2] Harbin Inst Technol, Biocomp Res Ctr, Shenzhen 518055, Peoples R China
[3] Shenzhen Key Lab Visual Object Detect & Recognit, Shenzhen 518055, Peoples R China
[4] Beijing Jiaotong Univ, Inst Informat Sci, Beijing 100044, Peoples R China
[5] Qingdao Univ, Coll Comp Sci & Technol, Qingdao 266071, Peoples R China
[6] Univ Macau, Dept Comp & Informat Sci, Macau 999078, Peoples R China
基金
中国国家自然科学基金;
关键词
Tensors; Correlation; Sparse matrices; Clustering methods; Task analysis; Estimation; Pairwise error probability; Multi-view clustering; nonconvex low-rank tensor approximation; spectral clustering; subspace clustering; REPRESENTATION;
D O I
10.1109/TIP.2021.3068646
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The low-rank tensor representation (LRTR) has become an emerging research direction to boost the multi-view clustering performance. This is because LRTR utilizes not only the pairwise relation between data points, but also the view relation of multiple views. However, there is one significant challenge: LRTR uses the tensor nuclear norm as the convex approximation but provides a biased estimation of the tensor rank function. To address this limitation, we propose the generalized nonconvex low-rank tensor approximation (GNLTA) for multi-view subspace clustering. Instead of the pairwise correlation, GNLTA adopts the low-rank tensor approximation to capture the high-order correlation among multiple views and proposes the generalized nonconvex low-rank tensor norm to well consider the physical meanings of different singular values. We develop a unified solver to solve the GNLTA model and prove that under mild conditions, any accumulation point is a stationary point of GNLTA. Extensive experiments on seven commonly used benchmark databases have demonstrated that the proposed GNLTA achieves better clustering performance over state-of-the-art methods.
引用
收藏
页码:4022 / 4035
页数:14
相关论文
共 59 条
[1]   Deep Multimodal Subspace Clustering Networks [J].
Abavisani, Mahdi ;
Patel, Vishal M. .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2018, 12 (06) :1601-1614
[2]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[3]   l0-Motivated Low-Rank Sparse Subspace Clustering [J].
Brbic, Maria ;
Kopriva, Ivica .
IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (04) :1711-1725
[4]   Diversity-induced Multi-view Subspace Clustering [J].
Cao, Xiaochun ;
Zhang, Changqing ;
Fu, Huazhu ;
Liu, Si ;
Zhang, Hua .
2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, :586-594
[5]  
Chen M., 2020, P AAI ART INT, P1
[6]   Low-Rank Tensor Graph Learning for Multi-View Subspace Clustering [J].
Chen, Yongyong ;
Xiao, Xiaolin ;
Peng, Chong ;
Lu, Guangming ;
Zhou, Yicong .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (01) :92-104
[7]   Adaptive Transition Probability Matrix Learning for Multiview Spectral Clustering [J].
Chen, Yongyong ;
Xiao, Xiaolin ;
Hua, Zhongyun ;
Zhou, Yicong .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (09) :4712-4726
[8]   Multi-view subspace clustering via simultaneously learning the representation tensor and affinity matrix [J].
Chen, Yongyong ;
Xiao, Xiaolin ;
Zhou, Yicong .
PATTERN RECOGNITION, 2020, 106
[9]   Jointly Learning Kernel Representation Tensor and Affinity Matrix for Multi-View Clustering [J].
Chen, Yongyong ;
Xiao, Xiaolin ;
Zhou, Yicong .
IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (08) :1985-1997
[10]   Graph-regularized least squares regression for multi-view subspace clustering [J].
Chen, Yongyong ;
Wang, Shuqin ;
Zheng, Fangying ;
Cen, Yigang .
KNOWLEDGE-BASED SYSTEMS, 2020, 194