Positive and negative association rule mining in Hadoop's MapReduce environment

被引：13

作者：

Bagui, Sikha ^{[1
]}

Dhar, Probal Chandra ^{[1
]}

机构：

[1] Univ West Florida, Dept Comp Sci, Pensacola, FL 32514 USA

来源：

JOURNAL OF BIG DATA | 2019年 / 6卷 / 01期

关键词：

Positive association rule mining; Negative association rule mining; Hadoop; MapReduce; Apriori; Big data; Frequent itemset mining; Parallel environment; Hadoop's Distributed File System (HDFS);

D O I：

10.1186/s40537-019-0238-8

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

In this paper, we present a Hadoop implementation of the Apriori algorithm. Using Hadoop's distributed and parallel MapReduce environment, we present an architecture to mine positive as well as negative association rules in big data using frequent itemset mining and the Apriori algorithm. We also analyze and present the results of a few optimization parameters in Hadoop's MapReduce environment as it relates to this algorithm. The results are presented based on the number of rules generated as well as the run-time efficiency. We find that, a higher amount of parallelization, which means larger block sizes, will increase the run-time efficiency of the Hadoop implementation of the Apriori algorithm.

引用

页数：16

共 50 条

[21] DCE -miner: an association rule mining algorithm for multimedia based on the MapReduce framework
LI Chengyan
Shixiang FENG
Guanglu SUN
Multimedia Tools and Applications, 2020, 79 : 16771 - 16793
[22] Association Rule Mining using Apriori for Large and Growing Datasets under Hadoop
Govada, Aruna
Patluri, Abhinav
Honnalgere, Atmika
PROCEEDINGS OF 2017 VI INTERNATIONAL CONFERENCE ON NETWORK, COMMUNICATION AND COMPUTING (ICNCC 2017), 2017, : 14 - 17
[23] Tunnel Security Management Based on Association Rule Mining under Hadoop Platform
Wang, Qun
Xue, Ting
MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022
[24] Application of MapReduce parallel association mining on IDS in cloud computing environment
Wu, Wentie
Xu, Shengchao
JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2020, 39 (02) : 1915 - 1923
[25] Join Operations to Enhance Performance in Hadoop MapReduce Environment
Pagadala, Pavan Kumar
Vikram, M.
Eswarawaka, Rajesh
Reddy, P. Srinivasa
PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON FRONTIERS IN INTELLIGENT COMPUTING: THEORY AND APPLICATIONS, (FICTA 2016), VOL 2, 2017, 516 : 491 - 500
[26] Mining Indirect Positive and Negative Association Rules
Ramasubbareddy, B.
Govardhan, A.
Ramamohanreddy, A.
ADVANCES IN COMPUTING AND COMMUNICATIONS, PT I, 2011, 190 : 581 - +
[27] Mining positive and negative fuzzy association rules
Yan, P
Chen, GQ
Cornelis, C
De Cock, M
Kerre, E
KNOWLEDGE-BASED INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS, PT 1, PROCEEDINGS, 2004, 3213 : 270 - 276
[28] Re-mining Positive and Negative Association Mining Results
Demiriz, Ayhan
Ertek, Gurdal
Atan, Tankut
Kula, Ufuk
ADVANCES IN DATA MINING: APPLICATIONS AND THEORETICAL ASPECTS, 2010, 6171 : 101 - +
[29] Mining Negative Association Rules in Distributed Environment
Sahu, Aneesh K.
Kumar, Raghvendra
Rahim, Naazish
2015 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMMUNICATION NETWORKS (CICN), 2015, : 934 - 937
[30] Personality Differences and Hotel Web Design Study Using Targeted Positive and Negative Association Rule Mining
Leung, Rosanna
Rong, Jia
Li, Gang
Law, Rob
JOURNAL OF HOSPITALITY MARKETING & MANAGEMENT, 2013, 22 (07) : 701 - 727

← 1 2 3 4 5 →