Research on parallel algorithm based on hadoop distributed computing platform

被引：4
作者：
Heilongjiang University of Technology, Jixi, China [1 ]
机构：
[1] Heilongjiang University of Technology, Jixi
来源：
Int. J. Grid Distrib. Comput. | / 4卷 / 163-170期
关键词：
3G network; Cloud computing; Data mining; Hadoop platform; Parallel computing;
D O I：
10.14257/ijgdc.2015.8.4.16
中图分类号：
学科分类号：
摘要：
With the rapid development of the 3G network, traditional calculation methods are unable to adapt to the data scene that telecom users' Network access behavior's data scale increase rapidly dozens of TB. The cloud techniques such as Hadoop platform are introduced to solve the data storage problem. The appropriate data mining algorithms are designed from the perspective of practical application. This paper improves the traditional decision tree SPRINT algorithms, proposes a parallel computing program and successfully applies to the Hadoop platform. © 2015 SERSC.
引用
收藏
页码：163 / 170
页数：7
相关论文
共 15 条
  • [1] Yanan Z., Research on parallel clustering algorithm Hadoop based on cloud computing platform, (2013)
  • [2] Guang G.J., Research on key technology of data mining for telecom field, (2012)
  • [3] Aiping C., Analysis and Application Research on parallel clustering algorithm based on Hadoop, (2012)
  • [4] Jun X., Yang G., Lin S., Yubin Y., Parallel text classification based on Hadoop platform, Computer science, 10, pp. 184-188, (2011)
  • [5] Shile L., Realization of Hadoop platform and the random forest algorithm research based on image classification system, (2014)
  • [6] Li H., Jun G., Parallel data classification algorithm based on Hadoop platform, The manufacturing industry automation, 14, pp. 5-9, (2014)
  • [7] Yong C., Design and implementation of algorithm of distributed data query communication platform based on Hadoop, (2009)
  • [8] Xiaofei H., Yuesheng T., Jingyu W., On the platform of Hadoop parallel algorithm research and implementation of Apriori, Computer and modernization, 3, pp. 1-4, (2013)
  • [9] Qiuwen W., Design and implementation of system for whole genome association studies based on Hadoop, (2012)
  • [10] Tao Z., Research and implementation of network text analysis based on Hadoop, (2014)
12