Diverse Deep Matrix Factorization with Hypergraph Regularization for Multi-View Data Representation

被引:35
作者
Huang, Haonan [1 ,2 ]
Zhou, Guoxu [1 ,2 ]
Liang, Naiyao [1 ]
Zhao, Qibin [1 ,3 ]
Xie, Shengli [4 ,5 ]
机构
[1] Guangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
[2] Minist Educ, Key Lab Intelligent Detect & Internet Things Mfg, Guangzhou 510006, Peoples R China
[3] RIKEN AIP, Tsukuba, Japan
[4] 111 Ctr Intelligent Batch Mfg Based IoT Technol GD, Guangzhou 510006, Peoples R China
[5] Guangdong Univ Technol, Guangdong Hong Kong Macao Joint Lab Smart Discrete, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep matrix factorization (DMF); diversity; hyper-graph regularization; multi-view data representation (MDR);
D O I
10.1109/JAS.2022.105980
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep matrix factorization (DMF) has been demon-strated to be a powerful tool to take in the complex hierarchical information of multi-view data (MDR). However, existing multi-view DMF methods mainly explore the consistency of multi-view data, while neglecting the diversity among different views as well as the high-order relationships of data, resulting in the loss of valuable complementary information. In this paper, we design a hypergraph regularized diverse deep matrix factorization (HDDMF) model for multi-view data representation, to jointly utilize multi-view diversity and a high-order manifold in a multi-layer factorization framework. A novel diversity enhancement term is designed to exploit the structural complementarity between different views of data. Hypergraph regularization is utilized to preserve the high-order geometry structure of data in each view. An efficient iterative optimization algorithm is developed to solve the proposed model with theoretical convergence analysis. Experimental results on five real-world data sets demonstrate that the proposed method significantly outperforms state-of-the-art multi-view learning approaches.
引用
收藏
页码:2154 / 2167
页数:14
相关论文
共 58 条
[1]   Deep multi-view document clustering with enhanced semantic embedding [J].
Bai, Ruina ;
Huang, Ruizhang ;
Chen, Yanping ;
Qin, Yongbin .
INFORMATION SCIENCES, 2021, 564 :273-287
[2]   Diversity-induced Multi-view Subspace Clustering [J].
Cao, Xiaochun ;
Zhang, Changqing ;
Fu, Huazhu ;
Liu, Si ;
Zhang, Hua .
2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, :586-594
[3]   Multi-view clustering via deep concept factorization [J].
Chang, Shuai ;
Hu, Jie ;
Li, Tianrui ;
Wang, Hao ;
Peng, Bo .
KNOWLEDGE-BASED SYSTEMS, 2021, 217
[4]  
Coates A., 2011, AISTATS
[5]  
Cui BL, 2019, PR MACH LEARN RES, V101, P567
[6]   Convex and Semi-Nonnegative Matrix Factorizations [J].
Ding, Chris ;
Li, Tao ;
Jordan, Michael I. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2010, 32 (01) :45-55
[7]   An overview of recent multi-view clustering [J].
Fu, Lele ;
Lin, Pengfei ;
Vasilakos, Athanasios V. ;
Wang, Shiping .
NEUROCOMPUTING, 2020, 402 :148-161
[8]   Multi-View Subspace Clustering [J].
Gao, Hongchang ;
Nie, Feiping ;
Li, Xuelong ;
Huang, Heng .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :4238-4246
[9]   Reducing the dimensionality of data with neural networks [J].
Hinton, G. E. ;
Salakhutdinov, R. R. .
SCIENCE, 2006, 313 (5786) :504-507
[10]   MULTI-VIEW DATA REPRESENTATION VIA DEEP AUTOENCODER-LIKE NONNEGATIVE MATRIX FACTORIZATION [J].
Huang, Haonan ;
Luo, Yihao ;
Zhou, Guoxu ;
Zhao, Qibin .
2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, :3338-3342