Dual-graph regularized non-negative matrix factorization with sparse and orthogonal constraints

被引:69
作者
Meng, Yang [1 ]
Shang, Ronghua [1 ]
Jiao, Licheng [1 ]
Zhang, Wenya [2 ]
Yang, Shuyuan [1 ]
机构
[1] Xidian Univ, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian 710071, Shaanxi, Peoples R China
[2] Xidian Univ, Sch Comp Sci, Xian 710071, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Semi-supervised non-negative matrix factorization; Dual-graph model; Orthogonal constraint; Bi-orthogonal constraints; Cluster; FRAMEWORK; PARTS;
D O I
10.1016/j.engappai.2017.11.008
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Semi-supervised Non-negative Matrix Factorization (NMF) can not only utilize a fraction of label information, but also effectively learn local information of the objectives, such as documents and faces. Semi-supervised NMF is an efficient technique for dimensionality reduction of high dimensional data. In this paper, we propose a novel semi-supervised NMF, called Dual-graph regularized Non-negative Matrix Factorization with Sparse and Orthogonal constraints (SODNMF). Dual-graph model is added into semi-supervised NMF, and the manifold structures of the data space and the feature space are taken into account simultaneously. In addition, the sparse constraint is used in SODNMF, which can simplify the calculation and accelerate the processing speed. The most important is that SODNMF makes use of bi-orthogonal constraints, which can avoid the non-correspondence between images and basic vectors. Therefore, it can effectively enhance the discrimination and the exclusivity of clustering, and improve the clustering performance. We give the objective function, the iterative updating rules and the convergence proof. Empirical experiments demonstrate encouraging results of our novel algorithm in comparison to four algorithms within some state-of-the-art algorithms through a set of evaluations based on three real datasets. (C) 2017 Elsevier Ltd. All rights reserved.
引用
收藏
页码:24 / 35
页数:12
相关论文
共 38 条
[31]  
Sindhwani V., 2009, Advances in Neural Information Processing Systems, P1505
[32]   Graph regularized and sparse nonnegative matrix factorization with hard constraints for data representation [J].
Sun, Fuming ;
Xu, Meixiang ;
Hu, Xuekao ;
Jiang, Xiaojun .
NEUROCOMPUTING, 2016, 173 :233-244
[33]   Cross-heterogeneous-database age estimation through correlation representation learning [J].
Tian, Qing ;
Chen, Songcan .
NEUROCOMPUTING, 2017, 238 :286-295
[34]  
Xu W., 2003, P 26 ANN INT ACM SIG, P267, DOI DOI 10.1145/860435.860485
[35]   L1/2 Regularization: A Thresholding Representation Theory and a Fast Solver [J].
Xu, Zongben ;
Chang, Xiangyu ;
Xu, Fengmin ;
Zhang, Hai .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (07) :1013-1027
[36]   L 1/2 regularization [J].
Xu ZongBen ;
Zhang Hai ;
Wang Yao ;
Chang XiangYu ;
Liang Yong .
SCIENCE CHINA-INFORMATION SCIENCES, 2010, 53 (06) :1159-1169
[37]   A convex relaxation framework for a class of semi-supervised learning methods and its application in pattern recognition [J].
Yang, Liming ;
Wang, Laisheng ;
Gao, Yongping ;
Sun, Qun ;
Zhao, Tengyang .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2014, 35 :335-344
[38]   Initialization enhancer for non-negative matrix factorization [J].
Zheng, Zhonglong ;
Yang, Jie ;
Zhu, Yitan .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2007, 20 (01) :101-110