Iterative big data clustering algorithms: a review

被引:44
作者
Mohebi, Amin [1 ]
Aghabozorgi, Saeed [1 ]
Teh Ying Wah [1 ]
Herawan, Tutut [1 ]
Yahyapour, Ramin [2 ]
机构
[1] Univ Malaya, Fac Comp Sci & Informat Technol, Kuala Lumpur, Malaysia
[2] Gesell Wissensch Datenverarbeitung mbH Gottingen, Gottingen, Germany
关键词
big data; large-scale; MapReduce; clustering; Hadoop; PARALLEL; MAPREDUCE; FRAMEWORK; MR;
D O I
10.1002/spe.2341
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Enterprises today are dealing with the massive size of data, which have been explosively increasing. The key requirements to address this challenge are to extract, analyze, and process data in a timely manner. Clustering is an essential data mining tool that plays an important role for analyzing big data. However, largescale data clustering has become a challenging task because of the large amount of information that emerges from technological progress in many areas, including finance and business informatics. Accordingly, researchers have dealt with parallel clustering algorithms using parallel programming models to address this issue. MapReduce is one of the most famous frameworks, and it has attracted great attention because of its flexibility, ease of programming, and fault tolerance. However, the framework has evident performance limitations, especially for iterative programs. This study will first review the proposed iterative frameworks that extended MapReduce to support iterative algorithms. We summarize these techniques, discuss their uniqueness and limitations, and explain how they address the challenging issues of iterative programs. We also perform an in-depth review to understand the problems and the solving techniques for parallel clustering algorithms. Hence, we believe that no well-rounded review provides a significant comparison among parallel clustering algorithms using MapReduce. This work aims to serve as a stepping stone for researchers who are studying big data clustering algorithms. Copyright (c) 2015 John Wiley & Sons, Ltd.
引用
收藏
页码:107 / 129
页数:23
相关论文
共 76 条
  • [1] Aiyer A.S., 2012, IEEE DATA ENG B, V35, P4
  • [2] Aljarah I, 2012, WOR CONG NAT BIOL, P104, DOI 10.1109/NaBIC.2012.6402247
  • [3] Ankerst M., 1999, SIGMOD Record, V28, P49, DOI 10.1145/304181.304187
  • [4] [Anonymous], 2000, SIGKDD Explorations
  • [5] [Anonymous], 2000, INFORM BOTTLENECK ME
  • [6] [Anonymous], 2012, Hadoop: The definitive guide
  • [7] [Anonymous], 1992, Graphs: Theory and Algorithms
  • [8] Arthur D, 2007, PROCEEDINGS OF THE EIGHTEENTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, P1027
  • [9] Assuncao MD, 2014, J PARALLEL DISTRIBUT, V75, P156
  • [10] Scalable K-Means++
    Bahmani, Bahman
    Moseley, Benjamin
    Vattani, Andrea
    Kumar, Ravi
    Vassilvitskii, Sergei
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2012, 5 (07): : 622 - 633