Implementation of an Alternating Least Square Model Based Collaborative Filtering Movie Recommendation System on Hadoop and Spark Platforms

被引:3
|
作者
Li, Jung-Bin [1 ]
Lin, Szu-Yin [2 ]
Hsu, Yu-Hsiang [1 ]
Huang, Ying-Chu [1 ]
机构
[1] Fu Jen Catholic Univ, Dept Stat & Informat Sci, New Taipei, Taiwan
[2] Chung Yuan Christian Univ, Dept Informat Management, Taoyuan, Taiwan
来源
ADVANCES ON BROADBAND AND WIRELESS COMPUTING, COMMUNICATION AND APPLICATIONS, BWCCA-2018 | 2019年 / 25卷
关键词
NEXT-GENERATION; SEQUENCING DATA; BIG DATA; MAPREDUCE;
D O I
10.1007/978-3-030-02613-4_21
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Nowadays, consumers and businesses all face the problem of information explosion. Recommendation systems represent a powerful solution This study practices a movie recommendation system to give suggestions of films to the movie-watcher, enabling him to consume more while shortening the time interval between payments. This research implements a prototype recommendation system based on collaborative filtering with Alternating Least Squares (ALS) algorithm. Collaborative filtering has the advantage of avoiding possible violation of the Personal Information Protection Act and reducing the possibility the errors caused by poor quality of personal information. However, one of its shortcomings is the scalability. Our study attempts to improve it by adopting Spark with Hadoop Yarn platform and uses it to compute movie recommendation and to store data respectively. The result of this research shows that the proposed system offers recommendations with satisfying accuracy while keeping acceptable computation time.
引用
收藏
页码:237 / 249
页数:13
相关论文
共 50 条
  • [1] An empirical study of alternating least squares collaborative filtering recommendation for Movielens on Apache Hadoop and Spark
    Li, Jung-Bin
    Lin, Szu-Yin
    Hsu, Yu-Hsiang
    Huang, Ying-Chu
    INTERNATIONAL JOURNAL OF GRID AND UTILITY COMPUTING, 2020, 11 (05) : 674 - 682
  • [2] An empirical study of alternating least squares collaborative filtering recommendation for movielens on apache hadoop and Spark
    Li J.-B.
    Lin S.-Y.
    Hsu Y.-H.
    Huang Y.-C.
    International Journal of Grid and Utility Computing, 2020, 11 (05): : 674 - 682
  • [3] Collaborative Filtering Recommendation Algorithm based on Hadoop and Spark
    Kupisz, Bartosz
    Unold, Olgierd
    2015 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY (ICIT), 2015, : 1510 - 1514
  • [4] Neural model based collaborative filtering for movie recommendation system
    Jena K.K.
    Bhoi S.K.
    Mallick C.
    Jena S.R.
    Kumar R.
    Long H.V.
    Son N.T.K.
    International Journal of Information Technology, 2022, 14 (4) : 2067 - 2077
  • [5] Design and Implementation of Movie Recommendation System Based on Knn Collaborative Filtering Algorithm
    Cui, Bei-Bei
    4TH ANNUAL INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND APPLICATIONS (ITA 2017), 2017, 12
  • [6] A personalised movie recommendation system based on collaborative filtering
    Subramaniyaswamy V.
    Logesh R.
    Chandrashekhar M.
    Challa A.
    Vijayakumar V.
    Subramaniyaswamy, V. (vsubramaniyaswamy@gmail.com), 2017, Inderscience Enterprises Ltd., 29, route de Pre-Bois, Case Postale 856, CH-1215 Geneva 15, CH-1215, Switzerland (10) : 54 - 63
  • [7] Time-aware parallel collaborative filtering movie recommendation based on Spark
    Zhang, Jing
    Yang, Dan
    INTERNATIONAL JOURNAL OF EMBEDDED SYSTEMS, 2020, 13 (04) : 449 - 458
  • [8] Movie Recommendation System Using Hybrid Collaborative Filtering Model
    Kale, Rohit
    Rudrawar, Saurabh
    Agrawal, Nikhil
    COMPUTATIONAL VISION AND BIO-INSPIRED COMPUTING ( ICCVBIC 2021), 2022, 1420 : 109 - 117
  • [9] Movie Recommendation System Using Collaborative Filtering
    Wu, Ching-Seh
    Garg, Deepti
    Bhandary, Unnathi
    PROCEEDINGS OF 2018 IEEE 9TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS), 2018, : 11 - 15
  • [10] Movie Recommender System Based on Collaborative Filtering Using Apache Spark
    Aljunid, Mohammed Fadhel
    Manjaiah, D. H.
    DATA MANAGEMENT, ANALYTICS AND INNOVATION, ICDMAI 2018, VOL 2, 2019, 839 : 283 - 295