A time- and memory-efficient frequent itemset discovering algorithm for association rule mining

被引:1
作者
Ivancsy, Renata [1 ,2 ]
Vajk, Istvan [1 ,2 ]
机构
[1] Budapest Univ Technol & Econ, Dept Automat & Appl, 3 Goldmann Gy Ter, H-1111 Budapest, Hungary
[2] HAS BUTE Control Res Grp, H-1111 Budapest, Hungary
关键词
association rule mining; frequent itemset; Apriori algorithm; FP-growth algorithm;
D O I
10.1504/IJCAT.2006.011998
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Frequent itemset discovering is a highly researched area in the field of data mining. The algorithms dealing with this problem have several advantages and disadvantages regarding their time complexity, I/O cost and memory requirement. There are algorithms that have moderate memory usage but high I/O cost, thus the execution time of them is high; such methods are for example the level-wise algorithms. Other methods have advantageous time behaviour; however, they are memory intensive, like the two-phase algorithms. In this paper, a novel algorithm, which is efficient both in time and memory, is proposed. The new algorithm discovers the small frequent itemsets quickly by taking advantage of the easy indexing opportunity of the suggested candidate storage structure. The main benefit of the novel algorithm is its advantageous time behaviour when using different types of datasets as well as its low I/O activity and moderate memory requirement.
引用
收藏
页码:270 / 280
页数:11
相关论文
共 50 条
[41]   ODAM: An optimized distributed association rule mining algorithm [J].
Ashrafi, Mafruz Zaman ;
Taniar, David ;
Smith, Kate .
IEEE Distributed Systems Online, 2004, 5 (03) :1-18
[42]   A Novel Algorithm for Association Rule Mining Without Candidate [J].
Zhou, Huanyin ;
Liu, Jinsheng .
FIRST IITA INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2009, :116-+
[43]   AN IMPROVED ALGORITHM FOR MINING ASSOCIATION RULE IN RELATIONAL DATABASE [J].
Wang, Pei ;
An, Chunhong ;
Wang, Lei .
PROCEEDINGS OF 2014 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), VOL 1, 2014, :247-252
[44]   Research of Association Rule Algorithm based on Data Mining [J].
Song, Changxin .
PROCEEDINGS OF 2016 IEEE INTERNATIONAL CONFERENCE ON BIG DATA ANALYSIS (ICBDA), 2016, :23-26
[45]   Adaptive-Miner: an efficient distributed association rule mining algorithm on Spark [J].
Rathee, Sanjay ;
Kashyap, Arti .
JOURNAL OF BIG DATA, 2018, 5 (01)
[46]   An efficient algorithm for association mining [J].
Jin, Kan .
2009 SECOND INTERNATIONAL SYMPOSIUM ON KNOWLEDGE ACQUISITION AND MODELING: KAM 2009, VOL 1, 2009, :291-295
[47]   An Approach to Improve Apriori Algorithm Based On Association rule Mining [J].
Yadav, Chanchal ;
Wang, Shuliang ;
Kumar, Manoj .
2013 FOURTH INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATIONS AND NETWORKING TECHNOLOGIES (ICCCNT), 2013,
[48]   A Depth-first Algorithm of Finding All Association Rules Generated by a Frequent Itemset [J].
武坤 ;
姜保庆 ;
魏庆 .
Journal of DongHua University, 2006, (06) :1-4+9
[49]   Association Rule Mining Algorithms and Genetic Algorithm: A Comparative Study [J].
Ghosh, Soumadip ;
Biswas, Susanta ;
Sarkar, Debasree ;
Sarkar, P. P. .
2012 THIRD INTERNATIONAL CONFERENCE ON EMERGING APPLICATIONS OF INFORMATION TECHNOLOGY (EAIT), 2012, :202-205
[50]   HFIM: a Spark-based hybrid frequent itemset mining algorithm for big data processing [J].
Krishan Kumar Sethi ;
Dharavath Ramesh .
The Journal of Supercomputing, 2017, 73 :3652-3668