IPARBC: An Improved Parallel Association Rule based on MapReduce Framework

被引:1
作者
Chang, Hong-Yi [1 ]
Hong, Zih-Huan [1 ]
Lin, Tu-Liang [1 ]
Chang, Wan-Kun [2 ]
Lin, Yi-Ying [2 ]
机构
[1] Natl Chiayi Univ, Dept Management Informat Syst, Chiayi, Taiwan
[2] Ind Technol Res Inst, Informat & Resource Technol Dept, Taichung, Taiwan
来源
PROCEEDINGS 2016 INTERNATIONAL CONFERENCE ON NETWORKING AND NETWORK APPLICATIONS NANA 2016 | 2016年
关键词
Data Mining Algorithm; Big Data; MapReduce Framework; Cloud Computing;
D O I
10.1109/NaNA.2016.78
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, data mining in big data has become an important concern for researchers. Data mining, which refers to mining the relationship between items in a dataset, has been applied by businesses to seek profitable outcomes. Association rule mining algorithms such as Apriori and the FP-growth are efficient methods for discovering relations between items in large databases. To enhance the performance, many researches tend to enhance the traditional method using the MapReduce framework. In this paper, we proposed an improved association rule algorithm (IPARBC) based on MapReduce framework. The concept of combinatorial mathematics is used as the theoretical basis of the algorithm, and in order to improve mining performance by MapReduce framework, we address the high volume problem of big data. Experimental results show that the proposed algorithm outperform other algorithms substantially in terms of runtime.
引用
收藏
页码:370 / 374
页数:5
相关论文
共 11 条
[1]  
Agrawal R., 1993, SIGMOD Record, V22, P207, DOI 10.1145/170036.170072
[2]  
[Anonymous], 1994, P INT C VERY LARGE D
[3]  
[Anonymous], MINING GEN ASS RULES
[4]  
Dean J, 2004, USENIX ASSOCIATION PROCEEDINGS OF THE SIXTH SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION (OSDE '04), P137
[5]  
Fayyad U, 1996, AI MAG, V17, P37
[6]   Research on Improved Apriori Algorithm Based on Coding and MapReduce [J].
Guo, Jian ;
Ren, Yong-gong .
2013 10TH WEB INFORMATION SYSTEM AND APPLICATION CONFERENCE (WISA 2013), 2013, :294-299
[7]   Mining frequent patterns without candidate generation: A frequent-pattern tree approach [J].
Han, JW ;
Pei, J ;
Yin, YW ;
Mao, RY .
DATA MINING AND KNOWLEDGE DISCOVERY, 2004, 8 (01) :53-87
[8]  
Park JS, 1997, IEEE T KNOWL DATA EN, V9, P813, DOI 10.1109/69.634757
[9]  
QIAN G.-c., 2008, COMPUTER ENG, V23
[10]  
[王永恒 WANG Yongheng], 2007, [计算机工程与科学, Computer Engineering and Science], V29, P110