SPPC: a new tree structure for mining erasable patterns in data streams

被引:0
作者
Tuong Le
Bay Vo
Philippe Fournier-Viger
Mi Young Lee
Sung Wook Baik
机构
[1] Sejong University,Digital Contents Research Institute
[2] Ton Duc Thang University,Division of Data Science
[3] Ton Duc Thang University,Faculty of Information Technology
[4] Harbin Institute of Technology (Shenzhen),School of Natural Sciences and Humanities
来源
Applied Intelligence | 2019年 / 49卷
关键词
Data mining; Data streams; Erasable patterns; Sliding window;
D O I
暂无
中图分类号
学科分类号
摘要
Discovering Erasable Patterns (EPs) consists of identifying product parts that will produce a small profit loss if their production is stopped. It is a data mining problem that has attracted the attention of numerous researchers in recent years due to the possibility of using EPs to reduce profit loss of manufacturers. Though, many algorithms have been designed to mine EPs, an important limitation of state-of-the-art EP mining algorithms is that they are batch algorithms, that is, they are designed to be applied on static databases. But in real-life applications, databases are dynamic, as they are constantly updated by adding or removing products and parts. To be informed about EPs in real-time, traditional EP mining algorithms must be applied over and over again on a database. This is inefficient as those algorithms are always applied from scratch without taking advantage of results generated by previous executions. Considering this important drawback of previous work for handling real-life dynamic data, this paper proposes an efficient algorithm named MSPPC for mining EPs in data streams. It relies on a novel tree structure named SPPC (Streaming Pre-Post Code) tree, which extends the WPPC tree structure for maintaining a compact tree representation of EPs in a data stream. Experimental results show that the designed MSPPC algorithm outperforms the state-of-the-art batch MERIT and dMERIT algorithms when they are run in batch mode using a sliding-window. Besides, the proposed algorithm is also faster than the state-of-the-art algorithms for mining EPs, namely MERIT, dMERIT + , MEI and EIFDD.
引用
收藏
页码:478 / 495
页数:17
相关论文
共 120 条
[1]  
Agarwal V(2015)Predicting the dynamics of social circles in ego networks using pattern analysis and GA K-means clustering WIREs: Data Min Knowl Discov 5 113-141
[2]  
Bharadwaj KK(2014)Assessment of data quality in accounting data with association rules Exp Syst Appl 41 2259-2268
[3]  
Alpar P(2006)Finding recently frequent itemsets adaptively over online transactional data streams Inf Syst 31 849-869
[4]  
Winkelsträter S(2009)estMax: tracing maximal frequent itemsets instantly over online transactional data streams IEEE Trans Knowl Data Eng 21 1418-1431
[5]  
Chang J(2014)Mining top-k frequent patterns over data streams sliding window J Intell Inf Syst 42 111-131
[6]  
Lee W(2012)Mining frequent patterns in a varying-size sliding-window of online transactional data streams Inf Sci 215 15-36
[7]  
Chang J(2011)Incremental mining of closed inter-transaction itemsets over data stream sliding windows J Inf Sci 37 208-220
[8]  
Lee W(2018)A social recommender system using item asymmetric correlation Appl Intell 48 527-540
[9]  
Chen H(2013)Mining top-rank-k erasable itemsets by PID_lists Int J Intell Syst 28 366-379
[10]  
Chen H(2016)DiffNodesets: an efficient structure for fast mining frequent itemsets Appl Soft Comput 41 214-223