Low-Rank Tensor Regularized Graph Fuzzy Learning for Multi-View Data Processing

被引:46
作者
Pan, Baicheng [1 ]
Li, Chuandong [1 ]
Che, Hangjun [1 ]
Leung, Man-Fai [2 ]
Yu, Keping [3 ,4 ]
机构
[1] Southwest Univ, Coll Elect & Informat Engn, Chongqing Key Lab Nonlinear Circuits & Intelligent, Chongqing 400715, Peoples R China
[2] Anglia Ruskin Univ, Fac Sci & Engn, Cambridge CB1 1PT, England
[3] Hosei Univ, Grad Sch Sci & Engn, Tokyo, Japan
[4] RIKEN, RIKEN Centerfor Adv Intelligence Project, Tokyo 1030027, Japan
基金
中国国家自然科学基金;
关键词
Tensors; Clustering methods; Matrix decomposition; Euclidean distance; Sparse matrices; Data processing; Singular value decomposition; Multi-view data processing; graph learning; low-rank tensor; fuzzy clustering; NONNEGATIVE MATRIX FACTORIZATION; ADAPTIVE GRAPH; ALGORITHM;
D O I
10.1109/TCE.2023.3301067
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Multi-view data processing is an effective tool to differentiate the levels of consumers on electronics. Recently, the graph based multi-view clustering methods have attracted widespread attention because they can obtain the relationships of multi-view data points efficiently. However, there exist several shortcomings on most existing graph based clustering methods. Firstly, the mostly adopted Euclidean distance can not extract the nonlinear manifold structure. Secondly, graph based methods are mainly hard clustering methods, which means that each data point belongs to only the one cluster exactly. Thirdly, the high-dimension information between multiple views are not taken into account. Thus, a low-rank tensor regularized graph fuzzy learning (LRTGFL) method for multi-view data processing is proposed. In LRTGFL, Jensen-Shannon divergence is adopted to replace the Euclidean distance for obtaining more completely nonlinear structures. In addition, fuzzy learning is adopted to make graph clustering be a soft clustering method. Furthermore, a tensor nuclear norm based on the tensor singular value decomposition (t-SVD) is adopted to take advantage of the high-dimension information. Then, alternating direction method of multipliers (ADMM) is adopted to solve the LRTGFL model. Finally, the effectiveness and superiority of LRTGFL are demonstrated by comparing with various state-of-the-art algorithms on eight real-world datasets.
引用
收藏
页码:2925 / 2938
页数:14
相关论文
共 48 条
[1]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[2]   Multi-view low-rank sparse subspace clustering [J].
Brbic, Maria ;
Kopriva, Ivica .
PATTERN RECOGNITION, 2018, 73 :247-258
[3]   Diversity-induced Multi-view Subspace Clustering [J].
Cao, Xiaochun ;
Zhang, Changqing ;
Fu, Huazhu ;
Liu, Si ;
Zhang, Hua .
2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, :586-594
[4]   Bicriteria Sparse Nonnegative Matrix Factorization via Two-Timescale Duplex Neurodynamic Optimization [J].
Che, Hangjun ;
Wang, Jun ;
Cichocki, Andrzej .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (08) :4881-4891
[5]   A nonnegative matrix factorization algorithm based on a discrete-time projection neural network [J].
Che, Hangjun ;
Wang, Jun .
NEURAL NETWORKS, 2018, 103 :63-71
[6]  
Che Hangjun, 2023, IEEE Transactions on Computational Social Systems
[7]   Clustering Empirical Failure Rate Curves for Reliability Prediction Purposes in the Case of Consumer Electronic Products [J].
Dombi, Jozsef ;
Jonas, Tamas ;
Toth, Zsuzsanna Eszter .
QUALITY AND RELIABILITY ENGINEERING INTERNATIONAL, 2016, 32 (03) :1071-1083
[8]   Sparse Subspace Clustering: Algorithm, Theory, and Applications [J].
Elhamifar, Ehsan ;
Vidal, Rene .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (11) :2765-2781
[9]   Multi-view projected clustering with graph learning [J].
Gao, Quanxue ;
Wan, Zhizhen ;
Liang, Ying ;
Wang, Qianqian ;
Liu, Yang ;
Shao, Ling .
NEURAL NETWORKS, 2020, 126 :335-346
[10]   Measuring Diversity in Graph Learning: A Unified Framework for Structured Multi-View Clustering [J].
Huang, Shudong ;
Tsang, Ivor W. ;
Xu, Zenglin ;
Lv, Jiancheng .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (12) :5869-5883