Positive and negative association rule mining in Hadoop's MapReduce environment

被引：13

作者：

Bagui, Sikha ^{[1
]}

Dhar, Probal Chandra ^{[1
]}

机构：

[1] Univ West Florida, Dept Comp Sci, Pensacola, FL 32514 USA

来源：

JOURNAL OF BIG DATA | 2019年 / 6卷 / 01期

关键词：

Positive association rule mining; Negative association rule mining; Hadoop; MapReduce; Apriori; Big data; Frequent itemset mining; Parallel environment; Hadoop's Distributed File System (HDFS);

D O I：

10.1186/s40537-019-0238-8

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

In this paper, we present a Hadoop implementation of the Apriori algorithm. Using Hadoop's distributed and parallel MapReduce environment, we present an architecture to mine positive as well as negative association rules in big data using frequent itemset mining and the Apriori algorithm. We also analyze and present the results of a few optimization parameters in Hadoop's MapReduce environment as it relates to this algorithm. The results are presented based on the number of rules generated as well as the run-time efficiency. We find that, a higher amount of parallelization, which means larger block sizes, will increase the run-time efficiency of the Hadoop implementation of the Apriori algorithm.

引用

页数：16

共 50 条

[31] Mining Interesting Positive and Negative Association Rule Based on Improved Genetic Algorithm (MIPNAR_GA)
Rai, Nikky Suryawanshi
Jain, Susheel
Jain, Anurag
INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2014, 5 (01) : 160 - 165
[32] The Association Rule Mining of Armored Equipment Maintenance Material Consumption Data Based on MapReduce
Lei, Z.
Sun, Y.
Sun, L. Y.
Zhang, Y.
PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND INFORMATION TECHNOLOGY (SEIT2015), 2016, : 171 - 174
[33] MapReduce Based Multilevel Association Rule Mining from Concept Hierarchical Sales Data
Prajapati, Dinesh J.
Garg, Sanjay
ADVANCES IN COMPUTING AND DATA SCIENCES, ICACDS 2016, 2017, 721 : 624 - 636
[34] Web Data Analysis Using Negative Association Rule Mining
Kumar, Raghvendra
Pattnaik, Prasant Kumar
Sharma, Yogesh
INFORMATION SYSTEMS DESIGN AND INTELLIGENT APPLICATIONS, VOL 1, INDIA 2016, 2016, 433 : 513 - 518
[35] Efficient negative association rule mining based on chance thresholds
Koh, Yun Sing
Pears, Russel
INTELLIGENT DATA ANALYSIS, 2014, 18 (02) : 243 - 260
[36] Optimized Mining of Potential Positive and Negative Association Rules
Bemarisika, Parfait
Totohasina, Andre
BIG DATA ANALYTICS AND KNOWLEDGE DISCOVERY, DAWAK 2017, 2017, 10440 : 424 - 432
[37] Mining Positive and Negative Association Rules with Weighted Items
Jiang, He
Zhao, Yuanyuan
Dong, Xiangjun
Shang, Shiju
DCABES 2008 PROCEEDINGS, VOLS I AND II, 2008, : 437 - 441
[38] An Algorithm for Mining Multidimensional Positive and Negative Association Rules
Jiang, He
Bai, Ze
Liu, Guoling
Luan, Xiumei
ACHIEVEMENTS IN ENGINEERING MATERIALS, ENERGY, MANAGEMENT AND CONTROL BASED ON INFORMATION TECHNOLOGY, PTS 1 AND 2, 2011, 171-172 : 445 - +
[39] Research on Mining Sequential Positive and Negative Association Rules
Jiang, He
Geng, Runian
Sun, Baoyou
ICICTA: 2009 SECOND INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTATION TECHNOLOGY AND AUTOMATION, VOL III, PROCEEDINGS, 2009, : 703 - 706
[40] Efficient mining of both positive and negative association rules
Wu, XD
Zhang, CQ
Zhang, SC
ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2004, 22 (03) : 381 - 405

← 1 2 3 4 5 →