Label prediction based constrained non-negative matrix factorization for semi-supervised multi-view classification

被引:1
作者
Liang, Naiyao [1 ]
Yang, Zuyuan [1 ]
Li, Zhenni [1 ,2 ]
Xie, Shengli [1 ,3 ]
机构
[1] Guangdong Univ Technol, Sch Automat, Guangdong Key Lab IoT Informat Technol, Guangzhou 510006, Peoples R China
[2] Minist Educ, Key Lab iDetect & Mfg IoT, Guangzhou 510006, Peoples R China
[3] Guangdong HongKong Macao Joint Lab Smart Discrete, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
Label prediction; Semi-supervised learning; Multi-view classification; Constrained non-negative matrix; factorization;
D O I
10.1016/j.neucom.2022.09.087
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Semi-supervised multi-view classification can improve the performance by leveraging the information from both labeled and unlabeled data. But it is often a challenge to capture the information from the unla-beled multi-view data. By analyzing the relation between labeled and unlabeled data under multi-view scenario, we propose a novel model with the ability of leveraging the latent label information from the unlabeled data. In our model, a label prediction (LP) term is proposed to jointly obtain the predicted labels of unlabeled data from multiple views. The LP term is integrated into a constrained non -negative matrix factorization based multi-view framework. In this way, the LP and the multi-view rep-resentation learning are integrated into one joint learning problem, where they boost each other. Particularly, the predicted label vector is formulated to be the one-hot vector, such that the labels can be obtained directly. Moreover, we propose a new lemma about the gradient of the '2;1 norm in the case of 3-factor matrix decomposition and its corollary about multi-factor matrix decomposition. Based on which, we develop an efficient algorithm and prove its convergence. Experimental results verify that our method can obtain state-of-the-art performance.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:443 / 455
页数:13
相关论文
共 41 条
[1]  
[Anonymous], 2010, Neural Inf. Process. Syst. Neural Inf. Process. Syst., DOI DOI 10.1007/978-3-319-10690-8_12
[2]   Graph Regularized Nonnegative Matrix Factorization for Data Representation [J].
Cai, Deng ;
He, Xiaofei ;
Han, Jiawei ;
Huang, Thomas S. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (08) :1548-1560
[3]   Semi-supervised multi-view clustering based on constrained nonnegative matrix factorization [J].
Cai, Hao ;
Liu, Bo ;
Xiao, Yanshan ;
Lin, LuYue .
KNOWLEDGE-BASED SYSTEMS, 2019, 182
[4]  
Cai X., 2013, P 23 INT JOINT C ART
[5]   An overview of recent multi-view clustering [J].
Fu, Lele ;
Lin, Pengfei ;
Vasilakos, Athanasios V. ;
Wang, Shiping .
NEUROCOMPUTING, 2020, 402 :148-161
[6]   Approximate Graph Laplacians for Multimodal Data Clustering [J].
Khan, Aparajita ;
Maji, Pradipta .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (03) :798-813
[7]   Learning the parts of objects by non-negative matrix factorization [J].
Lee, DD ;
Seung, HS .
NATURE, 1999, 401 (6755) :788-791
[8]  
Lee DD, 2001, ADV NEUR IN, V13, P556
[9]   Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories [J].
Li Fei-Fei ;
Fergus, Rob ;
Perona, Pietro .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2007, 106 (01) :59-70
[10]   Autoencoder Constrained Clustering With Adaptive Neighbors [J].
Li, Xuelong ;
Zhang, Rui ;
Wang, Qi ;
Zhang, Hongyuan .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (01) :443-449