Efficient Implementation of Apriori Algorithm on HDFS using GPU

被引:0
作者
Tiwary, Mayank [1 ]
Sahoo, Abhaya Kumar [1 ]
Misra, Rachita [1 ]
机构
[1] CV Raman Coll Engn, Dept Informat Technol, Bhubaneswar, Orissa, India
来源
2014 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND APPLICATIONS (ICHPCA) | 2014年
关键词
Hadoop; Map-reduce; CUDA; GPU; Apriori;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A very efficient distributed processing framework is provided by Hadoop. For processing big data, Hadoop uses map-reduce programming model. The proposed technique uses parallel apriori map-reduce algorithm using high performance GPU. The computationally intensive operations of mapping phase are offloaded to GPU. Apriori is a very basic data mining algorithm which is used to determine the frequent item sets in the transactional database. In Hadoop, big transactional database are stored in structured form. When the size of transactional database is big, very fast apriori technique is required to solve the problem. Past researches show a clear view of solving data mining operations in heterogeneous environment which increase the performance with a very high rate than older serial execution techniques. This paper introduces integration of GPU in map-reduce programming model to solve the apriori data mining technique in a very time efficient manner. For our experimental implementation, we use NVIDIA's GPU and for the integration process, we use JCUDA and JNI.
引用
收藏
页数:6
相关论文
共 10 条
  • [1] [Anonymous], 2010, COMPUTING COMMUNICAT
  • [2] Farivar R., 2009, PROC IEEE INT C CLUS, P1
  • [3] Govindaraju M., 2000, SUPERCOMPUTING 00, P61, DOI DOI 10.1109/SC.2000.10060
  • [4] GUO J, 2013, WEB INF SYST APPL C, P294
  • [5] Mars: A MapReduce Framework on Graphics Processors
    He, Bingsheng
    Fang, Wenbin
    Luo, Qiong
    Govindaraju, Naga K.
    Wang, Tuyong
    [J]. PACT'08: PROCEEDINGS OF THE SEVENTEENTH INTERNATIONAL CONFERENCE ON PARALLEL ARCHITECTURES AND COMPILATION TECHNIQUES, 2008, : 260 - 269
  • [6] Jian Liheng, J SUPER COMPUTING, V64, P942
  • [7] Malanjum R., 2013, P S SAB NAT LAND RIG, P1
  • [8] Sahoo Abhaya Kumar, 2014, IEEE INT C ADV COMM, P1951
  • [9] Yuan PS, 2010, LECT NOTES COMPUT SC, V6184, P169, DOI 10.1007/978-3-642-14246-8_19
  • [10] Zhang W, 2006, ICWS 2006: IEEE INTERNATIONAL CONFERENCE ON WEB SERVICES, PROCEEDINGS, P197