Dual-graph regularized non-negative matrix factorization with sparse and orthogonal constraints

被引:69
作者
Meng, Yang [1 ]
Shang, Ronghua [1 ]
Jiao, Licheng [1 ]
Zhang, Wenya [2 ]
Yang, Shuyuan [1 ]
机构
[1] Xidian Univ, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian 710071, Shaanxi, Peoples R China
[2] Xidian Univ, Sch Comp Sci, Xian 710071, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Semi-supervised non-negative matrix factorization; Dual-graph model; Orthogonal constraint; Bi-orthogonal constraints; Cluster; FRAMEWORK; PARTS;
D O I
10.1016/j.engappai.2017.11.008
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Semi-supervised Non-negative Matrix Factorization (NMF) can not only utilize a fraction of label information, but also effectively learn local information of the objectives, such as documents and faces. Semi-supervised NMF is an efficient technique for dimensionality reduction of high dimensional data. In this paper, we propose a novel semi-supervised NMF, called Dual-graph regularized Non-negative Matrix Factorization with Sparse and Orthogonal constraints (SODNMF). Dual-graph model is added into semi-supervised NMF, and the manifold structures of the data space and the feature space are taken into account simultaneously. In addition, the sparse constraint is used in SODNMF, which can simplify the calculation and accelerate the processing speed. The most important is that SODNMF makes use of bi-orthogonal constraints, which can avoid the non-correspondence between images and basic vectors. Therefore, it can effectively enhance the discrimination and the exclusivity of clustering, and improve the clustering performance. We give the objective function, the iterative updating rules and the convergence proof. Empirical experiments demonstrate encouraging results of our novel algorithm in comparison to four algorithms within some state-of-the-art algorithms through a set of evaluations based on three real datasets. (C) 2017 Elsevier Ltd. All rights reserved.
引用
收藏
页码:24 / 35
页数:12
相关论文
共 38 条
[1]  
[Anonymous], 2000, Pattern Classification, DOI DOI 10.1007/978-3-319-57027-3_4
[2]  
[Anonymous], IEEE T CYBERN
[3]   Discriminative Nonnegative Matrix Factorization for dimensionality reduction [J].
Babaee, Mohammadreza ;
Tsoukalas, Stefanos ;
Babaee, Maryam ;
Rigoll, Gerhard ;
Datcu, Mihai .
NEUROCOMPUTING, 2016, 173 :212-223
[4]  
Belkin M, 2006, J MACH LEARN RES, V7, P2399
[5]  
Cai D., 2009, Proceedings of the 26th Annual International Conference on Machine Learning, P105, DOI [10.1145/1553374.1553388, DOI 10.1145/1553374.1553388]
[6]   Graph Regularized Nonnegative Matrix Factorization for Data Representation [J].
Cai, Deng ;
He, Xiaofei ;
Han, Jiawei ;
Huang, Thomas S. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (08) :1548-1560
[7]  
Cai D, 2009, 21ST INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI-09), PROCEEDINGS, P1010
[8]  
Ding C, 2006, P 12 ACM SIGKDD INT, P126, DOI 10.1145/1150402.1150420
[9]   Label consistent semi-supervised non-negative matrix factorization for maintenance activities identification [J].
Feng, Xiaodong ;
Jiao, Yuting ;
Lv, Chuan ;
Zhou, Dong .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2016, 52 :161-167
[10]   Structural Minimax Probability Machine [J].
Gu, Bin ;
Sun, Xingming ;
Sheng, Victor S. .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (07) :1646-1656