A Nonnegative Latent Factor Model for Large-Scale Sparse Matrices in Recommender Systems via Alternating Direction Method

被引:206
作者
Luo, Xin [1 ,2 ]
Zhou, MengChu [3 ,4 ]
Li, Shuai [5 ]
You, Zhuhong [5 ]
Xia, Yunni [6 ]
Zhu, Qingsheng [6 ]
机构
[1] Chongqing Univ, Minist Educ, Key Lab Dependable Serv Comp Cyber Phys Soc, Chongqing 400044, Peoples R China
[2] Chongqing Univ, Chongqing Key Lab Software Theory & Technol, Chongqing 400044, Peoples R China
[3] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
[4] Tongji Univ, Minist Educ, Key Lab Embedded Syst & Serv Comp, Shanghai 201804, Peoples R China
[5] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Hong Kong, Peoples R China
[6] Chongqing Univ, Chongqing Key Lab Software Theory & Technol, Coll Comp Sci, Chongqing 400044, Peoples R China
基金
美国国家科学基金会;
关键词
Alternating direction method; big data; collaborative filtering; recommender system; sparse matrices; FACTORIZATION;
D O I
10.1109/TNNLS.2015.2415257
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nonnegative matrix factorization (NMF)-based models possess fine representativeness of a target matrix, which is critically important in collaborative filtering (CF)-based recommender systems. However, current NMF-based CF recommenders suffer from the problem of high computational and storage complexity, as well as slow convergence rate, which prevents them from industrial usage in context of big data. To address these issues, this paper proposes an alternating direction method (ADM)-based nonnegative latent factor (ANLF) model. The main idea is to implement the ADM-based optimization with regard to each single feature, to obtain high convergence rate as well as low complexity. Both computational and storage costs of ANLF are linear with the size of given data in the target matrix, which ensures high efficiency when dealing with extremely sparse matrices usually seen in CF problems. As demonstrated by the experiments on large, real data sets, ANLF also ensures fast convergence and high prediction accuracy, as well as the maintenance of nonnegativity constraints. Moreover, it is simple and easy to implement for real applications of learning systems.
引用
收藏
页码:579 / 592
页数:14
相关论文
共 58 条
[1]   Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions [J].
Adomavicius, G ;
Tuzhilin, A .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2005, 17 (06) :734-749
[2]  
[Anonymous], 2001, WWW, DOI 10.1145/371920.372071
[3]  
[Anonymous], 2010, P 2010 SIAM INT C DA
[4]  
[Anonymous], 2009, NONNEGATIVE MATRIX T
[5]  
[Anonymous], INF RETR
[6]  
[Anonymous], IEEE T SYST MAN CYBE
[7]   Predictive Approach for User Long-Term Needs in Content-Based Image Suggestion [J].
Boutemedjet, Sabri ;
Ziou, Djemel .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (08) :1242-1253
[8]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[9]  
Breese J. S., 1998, Uncertainty in Artificial Intelligence. Proceedings of the Fourteenth Conference (1998), P43
[10]   Typicality-Based Collaborative Filtering Recommendation [J].
Cai, Yi ;
Leung, Ho-fung ;
Li, Qing ;
Min, Huaqing ;
Tang, Jie ;
Li, Juanzi .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2014, 26 (03) :766-779