Robust Hypergraph Regularized Deep Non-Negative Matrix Factorization for Multi-View Clustering

被引:3
作者
Che, Hangjun [1 ]
Li, Chenglu [1 ]
Leung, Man-Fai [2 ]
Ouyang, Deqiang [3 ]
Dai, Xiangguang [4 ]
Wen, Shiping [5 ]
机构
[1] Southwest Univ, Coll Elect & Informat Engn, Chongqing Key Lab Nonlinear Circuits & Intelligent, Chongqing 400715, Peoples R China
[2] Anglia Ruskin Univ, Fac Sci & Engn, Sch Comp & Informat Sci, Cambridge CB1 1PT, England
[3] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[4] Chongqing Three Gorges Univ, Sch Comp Sci & Engn, Chongqing 404188, Peoples R China
[5] Univ Technol Sydney, Ultimo, NSW 2007, Australia
来源
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE | 2024年
基金
中国国家自然科学基金;
关键词
Matrix decomposition; Optimization; Measurement uncertainty; Manifolds; Semantics; Noise; Data mining; Consistency learning; hypergraph regularization; multi-view clustering; robust deep matrix factorization; GRAPH;
D O I
10.1109/TETCI.2024.3451352
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As the increasing heterogeneous data, mining valuable information from various views is in demand. Currently, deep matrix factorization (DMF) receives extensive attention because of its ability to discover latent hierarchical semantics of the data. However, the existing multi-view DMF methods have the following shortcomings: (1). Most of multi-view DMF methods exploit Frobenius norm as the reconstruction error measure, which is easily affected by noises and outliers. (2). A kNN-based graph keeps the geometric structure of the representation similar to the raw data, which fails to consider the higher-order relationships between instances. To solve these issues, in this research, a novel robust multi-view hypergraph regularized deep non-negative matrix factorization is proposed. Concretely, l(2, 1)-norm is adopted to measure the factorization error for enhancing the robustness. A hypergraph regularization is designed to discover the higher-order relationships between the instances. Additionally, a pair-wise consistency learning term is utilized to mine consistency information in multi-view data. An optimization algorithm based on iterative updating rules is developed for solving the proposed model, which makes the objective function value monotonically non-increase until convergence. Moreover, the convergence of the proposed optimization algorithm is validated theoretically and experimentally. Finally, abundant experiments are performed on six real world and two synthetic multi-view datasets to evaluate the performance of the proposed method and the comparison methods.
引用
收藏
页数:13
相关论文
共 51 条
  • [1] Multi-view clustering via deep concept factorization
    Chang, Shuai
    Hu, Jie
    Li, Tianrui
    Wang, Hao
    Peng, Bo
    [J]. KNOWLEDGE-BASED SYSTEMS, 2021, 217
  • [2] Diversity embedding deep matrix factorization for multi-view clustering
    Chen, Zexi
    Lin, Pengfei
    Chen, Zhaoliang
    Ye, Dongyi
    Wang, Shiping
    [J]. INFORMATION SCIENCES, 2022, 610 : 114 - 125
  • [3] Multi-View Clustering With the Cooperation of Visible and Hidden Views
    Deng, Zhaohong
    Liu, Ruixiu
    Xu, Peng
    Choi, Kup-Sze
    Zhang, Wei
    Tian, Xiaobin
    Zhang, Te
    Liang, Ling
    Qin, Bin
    Wang, Shitong
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (02) : 803 - 815
  • [4] Convex and Semi-Nonnegative Matrix Factorizations
    Ding, Chris
    Li, Tao
    Jordan, Michael I.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2010, 32 (01) : 45 - 55
  • [5] Unbalanced Incomplete Multi-View Clustering Via the Scheme of View Evolution: Weak Views are Meat; Strong Views Do Eat
    Fang, Xiang
    Hu, Yuchong
    Zhou, Pan
    Wu, Dapeng Oliver
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6 (04): : 913 - 927
  • [6] Re-weighted multi-view clustering via triplex regularized non-negative matrix factorization
    Feng, Lin
    Liu, Wenzhe
    Meng, Xiangzhu
    Zhang, Yong
    [J]. NEUROCOMPUTING, 2021, 464 (464) : 352 - 363
  • [7] Hypergraph Learning: Methods and Practices
    Gao, Yue
    Zhang, Zizhao
    Lin, Haojie
    Zhao, Xibin
    Du, Shaoyi
    Zou, Changqing
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (05) : 2548 - 2566
  • [8] Multi-view spectral clustering via integrating nonnegative embedding and spectral embedding
    Hu, Zhanxuan
    Nie, Feiping
    Wang, Rong
    Li, Xuelong
    [J]. INFORMATION FUSION, 2020, 55 : 251 - 259
  • [9] Multi-View Data Fusion Oriented Clustering via Nuclear Norm Minimization
    Huang, Aiping
    Zhao, Tiesong
    Lin, Chia-Wen
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 9600 - 9613
  • [10] Diverse Deep Matrix Factorization with Hypergraph Regularization for Multi-View Data Representation
    Huang, Haonan
    Zhou, Guoxu
    Liang, Naiyao
    Zhao, Qibin
    Xie, Shengli
    [J]. IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2023, 10 (11) : 2154 - 2167