A Novel Learning Rate Function and Its Application on the SVD plus plus Recommendation Algorithm

被引:18
作者
Jiao, Jiangli [1 ]
Zhang, Xueying [1 ]
Li, Fenglian [1 ]
Wang, Yan [1 ]
机构
[1] Taiyuan Univ Technol, Coll Informat & Comp, Taiyuan 030024, Peoples R China
来源
IEEE ACCESS | 2020年 / 8卷
基金
中国国家自然科学基金;
关键词
Computational efficiency; learning rate function; recommendation algorithm; singular value decomposition (SVD); MATRIX FACTORIZATION; NEURAL-NETWORK; SYSTEM; PREDICTION;
D O I
10.1109/ACCESS.2019.2960523
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The recommendation algorithm based on Singular Value Decomposition (SVD)++ is a widely used algorithm for its good prediction performance. However, with the rapid increase of data in smart societies, the poor computational performance of the SVD++ recommendation algorithm becomes a prominent disadvantage, for it takes a longer time to optimize the objective function during constructing the prediction model. The learning rate function is a significant factor in the prediction model based on the SVD++ recommendation algorithm. It can directly affect the convergence speed of the prediction model and the performance of the model. The traditional model uses an exponential function, natural exponential function or piecewise constant as its learning rate function. In this paper, a novel adaptive learning rate (ALR) function is proposed, which combines the exponential with linear functions, and the function is applied to the SVD++ recommendation algorithm. The highlights of the paper are as follows. First, with a larger initial value, the proposed function descends quicker and tends to the end with a less step. Second, the theoretical properties of the proposed learning rate function are verified through theoretical analysis, including the theoretical proof of its convergence and the iteration speed comparison. Compared to the existing learning rate functions, the proposed ALR function works better on the convergence speed through mathematical derivation. Finally, the novel ALR function is applied to the SVD++ recommendation algorithm as recommendation model ALRSVD++. Some existing learning rate methods are used as benchmarks for illustrating the computation and prediction performances of proposed ALR function and its ALRSVD++ model. Experimental results demonstrated that the SVD++ recommendation algorithm based on the proposed ALR function improved computational efficiency of the training model ALRSVD++ significantly. Especially, to the larger size training dataset, the iterations and training time based on the proposed ALR function and ALRSVD++ model reduced in a great deal, without greatly sacrificing the recommendation performance.
引用
收藏
页码:14112 / 14122
页数:11
相关论文
共 33 条
  • [1] [Anonymous], [No title captured]
  • [2] [Anonymous], [No title captured]
  • [3] Baltrunas Linas., 2009, CArs
  • [4] An ensemble method for top-N recommendations from the SVD
    Ben-Shimon, David
    Rokach, Lior
    Shapira, Bracha
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2016, 64 : 84 - 92
  • [5] Chen P, 2004, IEEE IMAGE PROC, P1005
  • [6] Positive unlabeled learning for building recommender systems in a parliamentary setting
    de Campos, Luis M.
    Fernandez-Luna, Juan M.
    Huete, Juan F.
    Redondo-Exposito, Luis
    [J]. INFORMATION SCIENCES, 2018, 433 : 221 - 232
  • [7] DEERWESTER S, 1990, J AM SOC INFORM SCI, V41, P391, DOI 10.1002/(SICI)1097-4571(199009)41:6<391::AID-ASI1>3.0.CO
  • [8] 2-9
  • [9] Duchi J, 2011, J MACH LEARN RES, V12, P2121
  • [10] Deep topology network: A framework based on feedback adjustment learning rate for image classification
    Fan, Long
    Zhang, Tao
    Zhao, Xin
    Wang, Hao
    Zheng, Mingming
    [J]. ADVANCED ENGINEERING INFORMATICS, 2019, 42