Parallel Implementation of Ant-Based Clustering Algorithm Based on Hadoop

被引：0

作者：

Yang, Yan ^{[1
]}

Ni, Xianhua ^{[1
]}

Wang, Hongjun ^{[1
]}

Zhao, Yiteng ^{[1
]}

机构：

[1] Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 610031, Peoples R China

来源：

ADVANCES IN SWARM INTELLIGENCE, ICSI 2012, PT I | 2012年 / 7331卷

关键词：

Ant-based Clustering; Parallelization; Hadoop; MapReduce model;

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Hadoop is a distributed system infrastructure of cloud computing. Based on the characteristics of ant-based clustering algorithm, the paper implements the parallelization of this algorithm using MapReduce on Hadoop. The Map function calculates the average similarity of the object with its neighborhood objects. The Reduce function processes the objects with the Map outputs and updates related information of both ants and the objects to get ready for the next job. Results on the Hadoop clusters show that our method can significantly improve the computational efficiency with the premise of maintaining clustering accuracy.

引用

页码：190 / 197

页数：8

共 7 条

[1] [Anonymous], 2003, P 19 ACM S OP SYST P, DOI [10.1145/1165389.945450, DOI 10.1145/1165389.945450]
[2] Apache Hadoop, AP HAD
[3] Borthakur D., HADOOP DISTRIBUTED F
[4] Dean J, 2004, USENIX ASSOCIATION PROCEEDINGS OF THE SIXTH SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION (OSDE '04), P137
[5] Smith A., 2000, IEEE Trans. Evolut. Computation, V4, P192, DOI [10.1109/TEVC.2000.850661, DOI 10.1109/TEVC.2000.850661]
[6] Reduction and turbulence characteristics in sub-zero temperature range of cationic and zwitterionic surfactants in EG/water solvent
Wei, J. J.
Kawaguchi, Y.
Li, F. C.
Yu, B.
Zakin, J. L.
Hart, D. J.
Oba, G.
Zhang, Y.
Ge, W.
[J]. JOURNAL OF TURBULENCE, 2009, 10 (10): : 1 - 15
[7] Clustering ensemble using swarm intelligence
Yang, Y
Kamel, M
[J]. PROCEEDINGS OF THE 2003 IEEE SWARM INTELLIGENCE SYMPOSIUM (SIS 03), 2003, : 65 - 71

← 1 →