Implementation of an Alternating Least Square Model Based Collaborative Filtering Movie Recommendation System on Hadoop and Spark Platforms
被引:3
|
作者:
Li, Jung-Bin
论文数: 0引用数: 0
h-index: 0
机构:
Fu Jen Catholic Univ, Dept Stat & Informat Sci, New Taipei, TaiwanFu Jen Catholic Univ, Dept Stat & Informat Sci, New Taipei, Taiwan
Li, Jung-Bin
[1
]
论文数: 引用数:
h-index:
机构:
Lin, Szu-Yin
[2
]
Hsu, Yu-Hsiang
论文数: 0引用数: 0
h-index: 0
机构:
Fu Jen Catholic Univ, Dept Stat & Informat Sci, New Taipei, TaiwanFu Jen Catholic Univ, Dept Stat & Informat Sci, New Taipei, Taiwan
Hsu, Yu-Hsiang
[1
]
Huang, Ying-Chu
论文数: 0引用数: 0
h-index: 0
机构:
Fu Jen Catholic Univ, Dept Stat & Informat Sci, New Taipei, TaiwanFu Jen Catholic Univ, Dept Stat & Informat Sci, New Taipei, Taiwan
Huang, Ying-Chu
[1
]
机构:
[1] Fu Jen Catholic Univ, Dept Stat & Informat Sci, New Taipei, Taiwan
[2] Chung Yuan Christian Univ, Dept Informat Management, Taoyuan, Taiwan
来源:
ADVANCES ON BROADBAND AND WIRELESS COMPUTING, COMMUNICATION AND APPLICATIONS, BWCCA-2018
|
2019年
/
25卷
关键词:
NEXT-GENERATION;
SEQUENCING DATA;
BIG DATA;
MAPREDUCE;
D O I:
10.1007/978-3-030-02613-4_21
中图分类号:
TN [电子技术、通信技术];
学科分类号:
0809 ;
摘要:
Nowadays, consumers and businesses all face the problem of information explosion. Recommendation systems represent a powerful solution This study practices a movie recommendation system to give suggestions of films to the movie-watcher, enabling him to consume more while shortening the time interval between payments. This research implements a prototype recommendation system based on collaborative filtering with Alternating Least Squares (ALS) algorithm. Collaborative filtering has the advantage of avoiding possible violation of the Personal Information Protection Act and reducing the possibility the errors caused by poor quality of personal information. However, one of its shortcomings is the scalability. Our study attempts to improve it by adopting Spark with Hadoop Yarn platform and uses it to compute movie recommendation and to store data respectively. The result of this research shows that the proposed system offers recommendations with satisfying accuracy while keeping acceptable computation time.