Positive and negative association rule mining in Hadoop's MapReduce environment

被引：13

作者：

Bagui, Sikha ^{[1
]}

Dhar, Probal Chandra ^{[1
]}

机构：

[1] Univ West Florida, Dept Comp Sci, Pensacola, FL 32514 USA

来源：

JOURNAL OF BIG DATA | 2019年 / 6卷 / 01期

关键词：

Positive association rule mining; Negative association rule mining; Hadoop; MapReduce; Apriori; Big data; Frequent itemset mining; Parallel environment; Hadoop's Distributed File System (HDFS);

D O I：

10.1186/s40537-019-0238-8

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

In this paper, we present a Hadoop implementation of the Apriori algorithm. Using Hadoop's distributed and parallel MapReduce environment, we present an architecture to mine positive as well as negative association rules in big data using frequent itemset mining and the Apriori algorithm. We also analyze and present the results of a few optimization parameters in Hadoop's MapReduce environment as it relates to this algorithm. The results are presented based on the number of rules generated as well as the run-time efficiency. We find that, a higher amount of parallelization, which means larger block sizes, will increase the run-time efficiency of the Hadoop implementation of the Apriori algorithm.

引用

页数：16

共 50 条

[1] Positive and negative association rule mining in Hadoop’s MapReduce environment
Sikha Bagui
Probal Chandra Dhar
Journal of Big Data, 6
[2] Mining Positive and Negative Association Rules in Hadoop's MapReduce Environment
Bagui, Sikha
Dhar, Probal Chandra
ACMSE '18: PROCEEDINGS OF THE ACMSE 2018 CONFERENCE, 2018,
[3] Data mining association rule algorithm based on Hadoop
Huang Suyu
PROCEEDINGS OF 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTATION TECHNOLOGY AND AUTOMATION (ICICTA 2015), 2015, : 349 - 352
[4] Association rule mining method based on interest measure with positive and negative items
Zhang Y.-F.
Xiong Z.-Y.
Peng Y.
Liu J.
Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2010, 39 (03): : 407 - 411
[5] A novel approach of multilevel positive and negative association rule mining for spatial databases
Sharma, LK
Vyas, OP
Tiwary, US
Vyas, R
MACHINE LEARNING AND DATA MINING IN PATTERN RECOGNITION, PROCEEDINDS, 2005, 3587 : 620 - 629
[6] Context based positive and negative spatio-temporal association rule mining
Shaheen, Muhammad
Shahbaz, Muhammad
Guergachi, Aziz
KNOWLEDGE-BASED SYSTEMS, 2013, 37 : 261 - 273
[7] Using Hadoop MapReduce in a Multicluster Environment
Tomasic, I.
Rashkovska, A.
Depolli, M.
2013 36TH INTERNATIONAL CONVENTION ON INFORMATION AND COMMUNICATION TECHNOLOGY, ELECTRONICS AND MICROELECTRONICS (MIPRO), 2013, : 345 - 350
[8] ScadiBino: An effective MapReduce-based association rule mining method
Barkhordari, Mohammadhossein
Niamanesh, Mahdi
PROCEEDINGS OF THE SIXTEENTH INTERNATIONAL CONFERENCE ON ELECTRONIC COMMERCE (ICEC 2014), 2014, : 1 - 8
[9] Fuzzy improved firefly-based MapReduce for association rule mining
Driff L.N.
Drias H.
International Journal of Innovative Computing and Applications, 2023, 14 (1-2) : 104 - 123
[10] Positive and Negative Association Rule Mining Using Correlation Threshold and Dual Confidence Approach
Paul, Animesh
COMPUTATIONAL INTELLIGENCE IN DATA MINING, VOL 1, CIDM 2015, 2016, 410 : 249 - 260

← 1 2 3 4 5 →