Robust non-negative matrix factorization via joint sparse and graph regularization for transfer learning

被引:0
作者
Shizhun Yang
Chenping Hou
Changshui Zhang
Yi Wu
机构
[1] National University of Defense Technology,Department of Mathematics and System Science
[2] Tsinghua University,State Key Laboratory of Intelligent Technology and Systems, Tsinghua National Laboratory for Information Science and Technology (TNList), Department of Automation
来源
Neural Computing and Applications | 2013年 / 23卷
关键词
Transfer learning; Non-negative matrix factorization; Sparse regularization; Graph regularization;
D O I
暂无
中图分类号
学科分类号
摘要
In real-world applications, we often have to deal with some high-dimensional, sparse, noisy, and non-independent identically distributed data. In this paper, we aim to handle this kind of complex data in a transfer learning framework, and propose a robust non-negative matrix factorization via joint sparse and graph regularization model for transfer learning. First, we employ robust non-negative matrix factorization via sparse regularization model (RSNMF) to handle source domain data and then learn a meaningful matrix, which contains much common information between source domain and target domain data. Second, we treat this learned matrix as a bridge and transfer it to target domain. Target domain data are reconstructed by our robust non-negative matrix factorization via joint sparse and graph regularization model (RSGNMF). Third, we employ feature selection technique on new sparse represented target data. Fourth, we provide novel efficient iterative algorithms for RSNMF model and RSGNMF model and also give rigorous convergence and correctness analysis separately. Finally, experimental results on both text and image data sets demonstrate that our REGTL model outperforms existing start-of-art methods.
引用
收藏
页码:541 / 559
页数:18
相关论文
共 68 条
[1]  
Lee DD(1999)Learning the parts of objects by nonnegative matrix factorization Nature 401 788-791
[2]  
Seung HS(2001)Algorithms for non-negative matrix factorization Adv Neural Inf Process Syst 13 556-562
[3]  
Lee DD(2011)Graph regularization non-negative matrix factorization for data representation IEEE Trans Pattern Anal Mach Intell 33 1548-1560
[4]  
Seung HS(2012)Constrained nonnegative matrix factorization for image representation IEEE Trans Pattern Anal Mach Intell 34 1299-1311
[5]  
Cai D(2012)Graph dual regularization non-negative matrix factorization for co-clustering Pattern Recogn 45 2237-2250
[6]  
He X(2011)Robust non-negative matrix factorization Front Electr Electron Eng China 6 192-200
[7]  
Han J(2004)Non-negative matrix factorization with sparseness constraints J Mach Learn Res 5 1457-1469
[8]  
Huang TS(2010)A survey on transfer learning IEEE Trans Knowl Data Eng 22 1345-1359
[9]  
Liu H(2008)Non-negative matrix factorization with alpha-divergence Pattern Recogn Lett 29 1433-1440
[10]  
Wu Z(2011)Divergence functions of non negative matrix factorization: a comparison study, communications Stat Simul Comput 40 1594-1612