Robust Hypergraph Regularized Deep Non-Negative Matrix Factorization for Multi-View Clustering

被引:8
作者
Che, Hangjun [1 ]
Li, Chenglu [1 ]
Leung, Man-Fai [2 ]
Ouyang, Deqiang [3 ]
Dai, Xiangguang [4 ]
Wen, Shiping [5 ]
机构
[1] Southwest Univ, Coll Elect & Informat Engn, Chongqing Key Lab Nonlinear Circuits & Intelligent, Chongqing 400715, Peoples R China
[2] Anglia Ruskin Univ, Fac Sci & Engn, Sch Comp & Informat Sci, Cambridge CB1 1PT, England
[3] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[4] Chongqing Three Gorges Univ, Sch Comp Sci & Engn, Chongqing 404188, Peoples R China
[5] Univ Technol Sydney, Ultimo, NSW 2007, Australia
来源
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE | 2025年 / 9卷 / 02期
基金
中国国家自然科学基金;
关键词
Matrix decomposition; Optimization; Measurement uncertainty; Manifolds; Semantics; Noise; Data mining; Consistency learning; hypergraph regularization; multi-view clustering; robust deep matrix factorization; GRAPH;
D O I
10.1109/TETCI.2024.3451352
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As the increasing heterogeneous data, mining valuable information from various views is in demand. Currently, deep matrix factorization (DMF) receives extensive attention because of its ability to discover latent hierarchical semantics of the data. However, the existing multi-view DMF methods have the following shortcomings: (1). Most of multi-view DMF methods exploit Frobenius norm as the reconstruction error measure, which is easily affected by noises and outliers. (2). A kNN-based graph keeps the geometric structure of the representation similar to the raw data, which fails to consider the higher-order relationships between instances. To solve these issues, in this research, a novel robust multi-view hypergraph regularized deep non-negative matrix factorization is proposed. Concretely, l(2, 1)-norm is adopted to measure the factorization error for enhancing the robustness. A hypergraph regularization is designed to discover the higher-order relationships between the instances. Additionally, a pair-wise consistency learning term is utilized to mine consistency information in multi-view data. An optimization algorithm based on iterative updating rules is developed for solving the proposed model, which makes the objective function value monotonically non-increase until convergence. Moreover, the convergence of the proposed optimization algorithm is validated theoretically and experimentally. Finally, abundant experiments are performed on six real world and two synthetic multi-view datasets to evaluate the performance of the proposed method and the comparison methods.
引用
收藏
页码:1817 / 1829
页数:13
相关论文
共 51 条
[1]  
[Anonymous], 2011, P 20 ACM INT C INF K
[2]   Multi-view clustering via deep concept factorization [J].
Chang, Shuai ;
Hu, Jie ;
Li, Tianrui ;
Wang, Hao ;
Peng, Bo .
KNOWLEDGE-BASED SYSTEMS, 2021, 217
[3]   Diversity embedding deep matrix factorization for multi-view clustering [J].
Chen, Zexi ;
Lin, Pengfei ;
Chen, Zhaoliang ;
Ye, Dongyi ;
Wang, Shiping .
INFORMATION SCIENCES, 2022, 610 :114-125
[4]   Multi-View Clustering With the Cooperation of Visible and Hidden Views [J].
Deng, Zhaohong ;
Liu, Ruixiu ;
Xu, Peng ;
Choi, Kup-Sze ;
Zhang, Wei ;
Tian, Xiaobin ;
Zhang, Te ;
Liang, Ling ;
Qin, Bin ;
Wang, Shitong .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (02) :803-815
[5]   Convex and Semi-Nonnegative Matrix Factorizations [J].
Ding, Chris ;
Li, Tao ;
Jordan, Michael I. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2010, 32 (01) :45-55
[6]   Unbalanced Incomplete Multi-View Clustering Via the Scheme of View Evolution: Weak Views are Meat; Strong Views Do Eat [J].
Fang, Xiang ;
Hu, Yuchong ;
Zhou, Pan ;
Wu, Dapeng Oliver .
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6 (04) :913-927
[7]   Re-weighted multi-view clustering via triplex regularized non-negative matrix factorization [J].
Feng, Lin ;
Liu, Wenzhe ;
Meng, Xiangzhu ;
Zhang, Yong .
NEUROCOMPUTING, 2021, 464 (464) :352-363
[8]   Hypergraph Learning: Methods and Practices [J].
Gao, Yue ;
Zhang, Zizhao ;
Lin, Haojie ;
Zhao, Xibin ;
Du, Shaoyi ;
Zou, Changqing .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (05) :2548-2566
[9]   Multi-view spectral clustering via integrating nonnegative embedding and spectral embedding [J].
Hu, Zhanxuan ;
Nie, Feiping ;
Wang, Rong ;
Li, Xuelong .
INFORMATION FUSION, 2020, 55 :251-259
[10]   Multi-View Data Fusion Oriented Clustering via Nuclear Norm Minimization [J].
Huang, Aiping ;
Zhao, Tiesong ;
Lin, Chia-Wen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :9600-9613