Research on big data mining based on improved parallel collaborative filtering algorithm

被引:6
作者
Zhu, Li [1 ]
Li, Heng [1 ]
Feng, Yuxuan [1 ]
机构
[1] Jilin Agr Univ, Coll Informat Technol, Changchun 130118, Jilin, Peoples R China
来源
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS | 2019年 / 22卷 / 02期
关键词
Big data; Data mining; Collaborative filtering; Parallelization; Spark;
D O I
10.1007/s10586-018-2209-9
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the big data age, the traditional parallel collaborative filtering algorithm cannot meet the needs of data analysis in the efficiency and accuracy of data processing. Therefore, this paper improves the traditional parallel collaborative filtering algorithm, analyzes the execution flow of the collaborative filtering algorithm, discusses the shortcomings of the traditional parallel collaborative filtering algorithm, and then describes in detail the steps of improved the collaborative filtering algorithm from generating nodes scoring vectors, obtaining neighboring nodes and forming recommendation information. Finally, the improved parallel collaborative filtering algorithm is verified through three aspects of running time, speedup and recommended accuracy. Experimental results show that the improved parallel collaborative filtering algorithm proposed in this paper has better running efficiency and higher recommendation accuracy than traditional parallel algorithm based on co-occurrence matrix.
引用
收藏
页码:S3595 / S3604
页数:10
相关论文
共 29 条
  • [1] [Anonymous], IEEE T PARALLEL DIST
  • [2] Cai R, 2016, INT SYM COMPUT INTEL, P370, DOI [10.1109/ISCID.2016.2094, 10.1109/ISCID.2016.199]
  • [3] Che J, 2015, APPL ELECT TECH, V34, P135
  • [4] Effect of metformin on insulin-resistant endothelial cell function
    Chen, Haiyan
    Li, Jie
    Yang, Ou
    Kong, Jian
    Lin, Guangzhu
    [J]. ONCOLOGY LETTERS, 2015, 9 (03) : 1149 - 1153
  • [5] Chen MS, 2017, INT CONF INFO SCI, P8, DOI 10.1109/ICIST.2017.7926501
  • [6] Cui J, 2015, PARALLELIZING K MEAN, V20, P21
  • [7] Gu Y.Z., 2017, ISPRS INT ARCH PHOTO, VXLII-2/W7, P1173
  • [8] Hewanadungodage C, 2016, KNOWL INF SYST, V39, P1
  • [9] A Hybrid Multigroup Coclustering Recommendation Framework Based on Information Fusion
    Huang, Shanshan
    Ma, Jun
    Cheng, Peizhe
    Wang, Shuaiqiang
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2015, 6 (02)
  • [10] Jain A., 2017, COLLABORATIVE FILTER