Attribute Reduction for Massive Data Based on Rough Set Theory and MapReduce

被引:0
作者
Yang, Yong [1 ]
Chen, Zhengrong [1 ]
Liang, Zhu [1 ]
Wang, Guoyin [1 ]
机构
[1] Chongqing Univ Posts & Telecommun, Inst Comp Sci & Technol, Chongqing 400065, Peoples R China
来源
ROUGH SET AND KNOWLEDGE TECHNOLOGY (RSKT) | 2010年 / 6401卷
关键词
Attribute reduction; rough set; MapReduce;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Data processing and knowledge discovery for massive data is always a hot topic in data mining, along with the era of cloud computing is coming, data mining for massive data is becoming a highlight research topic. In this paper, attribute reduction for massive data based on rough set theory is studied. The parallel programming mode of MapReduce is introduced and combined with the attribute reduction algorithm of rough set theory, a parallel attribute reduction algorithm based on MapReduce is proposed, experiment results show that the proposed method is more efficiency for massive data mining than traditional method, and it is a effective method effective method effective method for data mining on cloud computing platform.
引用
收藏
页码:672 / 678
页数:7
相关论文
共 12 条
[1]  
[Anonymous], 1992, Intelligent Decision Support. Handbook of Applications and Advances of the Rough Sets Theory, DOI DOI 10.1007/978-94-015-7975-9_21
[2]  
[Anonymous], 2001, Rough Set Theory and Knowledge Acquisition
[3]  
Dean J, 2004, USENIX ASSOCIATION PROCEEDINGS OF THE SIXTH SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION (OSDE '04), P137
[4]  
Ekanayake J., 2008, eScience, P277, DOI DOI 10.1109/ESCIENCE.2008.59
[5]  
[胡峰 HU Feng], 2007, [计算机学报, Chinese Journal of Computers], V30, P1429
[6]   Parallel PSO using MapReduce [J].
McNabb, Andrew W. ;
Monson, Christopher K. ;
Seppi, Kevin D. .
2007 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1-10, PROCEEDINGS, 2007, :7-+
[7]  
Miao D., 1999, J. Comput. Res. Dev., V36, P681
[8]  
Pawlak Z., 1984, Bulletin of the European Association for Theoretical Computer Science, P94
[9]   ROUGH CLASSIFICATION [J].
PAWLAK, Z .
INTERNATIONAL JOURNAL OF MAN-MACHINE STUDIES, 1984, 20 (05) :469-483
[10]  
Shafer J, 1996, PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON VERY LARGE DATA BASES, P544