Efficiently mining frequent itemsets with compact FP-tree

被引:0
作者
Qin, LX [1 ]
Luo, P [1 ]
Shi, ZZ [1 ]
机构
[1] Chinese Acad Sci, Comp Technol Inst, Key Lab Intelligent Informat Proc, Beijing 100080, Peoples R China
来源
INTELLIGENT INFORMATION PROCESSING II | 2005年 / 163卷
关键词
association rule; frequent patterns; compact FP-tree;
D O I
10.1007/0-387-23152-8_51
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
FP-growth algorithm is an efficient algorithm for mining frequent patterns. It scans database only twice and does not need to generate and test the candidate sets that is quite time consuming. The efficiency of the FP-growth algorithm outperforms previously developed algorithms. But, it must recursively generate huge number of conditional FP-trees that requires much more memory and costs more time. In this paper, we present an algorithm, CFPmine, that is inspired by several previous works. CFPmine algorithm combines several advantages of existing techniques. One is using constrained subtrees of a compact FP-tree to mine frequent pattern, so that it is doesn't need to construct conditional FP-trees in the mining process. Second is using an array-based technique to reduce the traverse time to the CFP-tree. And an unified memeory management is also implemented in the algorithm. The experimental evaluation shows that CFPmine algorithm is a high performance algorithm. It outperforms Apriori, Eclat and FP-growth and requires less memory than FP-growth.
引用
收藏
页码:397 / 406
页数:10
相关论文
共 50 条
[21]   SbFP-Growth: A Step to Remove the Bottleneck of FP-Tree [J].
Ahmed, Shafiul Alom ;
Nath, Bhabesh ;
Talukdar, Abhijeet .
RECENT DEVELOPMENTS IN MACHINE LEARNING AND DATA ANALYTICS, 2019, 740 :285-296
[22]   Batch incremental processing for FP-tree construction using FP-Growth algorithm [J].
Totad, Shashikumar G. ;
Geeta, R. B. ;
Reddy, P. V. G. D. Prasad .
KNOWLEDGE AND INFORMATION SYSTEMS, 2012, 33 (02) :475-490
[23]   Batch incremental processing for FP-tree construction using FP-Growth algorithm [J].
Shashikumar G. Totad ;
R. B. Geeta ;
P. V. G. D. Prasad Reddy .
Knowledge and Information Systems, 2012, 33 :475-490
[24]   Frequent closed itemsets lattice used in data mining [J].
Cheng, ZH ;
Jia, L ;
Pei, RQ .
PROCEEDINGS OF THE 2004 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2004, :1745-1748
[25]   An efficient algorithm of frequent itemsets mining based on MapReduce [J].
Wang, Le ;
Feng, Lin ;
Zhang, Jing ;
Liao, Pengyu .
Journal of Information and Computational Science, 2014, 11 (08) :2809-2816
[26]   Mining Frequent Itemsets Using Improved Apriori on Spark [J].
Gao, Fei ;
Khandelwal, Ashutosh ;
Liu, Jiangjiang .
PROCEEDINGS OF 3RD INTERNATIONAL CONFERENCE ON INFORMATION SYSTEM AND DATA MINING (ICISDM 2019), 2019, :87-91
[27]   Association Rule Mining: A Graph Based Approach for Mining Frequent Itemsets [J].
Tiwari, Vivek ;
Tiwari, Vipin ;
Gupta, Shailendra ;
Tiwari, Renu .
2010 INTERNATIONAL CONFERENCE ON NETWORKING AND INFORMATION TECHNOLOGY (ICNIT 2010), 2010, :309-313
[28]   Efficient mining of frequent itemsets from data streams [J].
Leung, Carson Kai-Sang ;
Brajczuk, Dale A. .
SHARING DATA, INFORMATION AND KNOWLEDGE, PROCEEDINGS, 2008, 5071 :2-14
[29]   Mining frequent closed itemsets without candidate generation [J].
Chen, K .
PARALLEL AND DISTRIBUTED PROCESSING AND APPLICATIONS, 2005, 3758 :668-677
[30]   NECLATCLOSED: A vertical algorithm for mining frequent closed itemsets [J].
Aryabarzan, Nader ;
Minaei-Bidgoli, Behrouz .
EXPERT SYSTEMS WITH APPLICATIONS, 2021, 174