Efficient Implementation of Apriori Algorithm on HDFS using GPU

被引:0
|
作者
Tiwary, Mayank [1 ]
Sahoo, Abhaya Kumar [1 ]
Misra, Rachita [1 ]
机构
[1] CV Raman Coll Engn, Dept Informat Technol, Bhubaneswar, Orissa, India
关键词
Hadoop; Map-reduce; CUDA; GPU; Apriori;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A very efficient distributed processing framework is provided by Hadoop. For processing big data, Hadoop uses map-reduce programming model. The proposed technique uses parallel apriori map-reduce algorithm using high performance GPU. The computationally intensive operations of mapping phase are offloaded to GPU. Apriori is a very basic data mining algorithm which is used to determine the frequent item sets in the transactional database. In Hadoop, big transactional database are stored in structured form. When the size of transactional database is big, very fast apriori technique is required to solve the problem. Past researches show a clear view of solving data mining operations in heterogeneous environment which increase the performance with a very high rate than older serial execution techniques. This paper introduces integration of GPU in map-reduce programming model to solve the apriori data mining technique in a very time efficient manner. For our experimental implementation, we use NVIDIA's GPU and for the integration process, we use JCUDA and JNI.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] Design and implementation of algorithm Apriori based on iterative MapReduce
    Ji, G. (glji@njnu.edu.cn), 1600, Huazhong University of Science and Technology (40):
  • [42] Implementation of K-shortest path algorithm in GPU using CUDA
    AvadheshPratapSingh
    DhirendraPratapSingh
    INTERNATIONAL CONFERENCE ON COMPUTER, COMMUNICATION AND CONVERGENCE (ICCC 2015), 2015, 48 : 5 - 13
  • [43] Implementation of the QGD Algorithm Using AMR Technology and GPU Parallel Computing
    But, Ivan
    Epikhin, Andrey
    Kirushina, Maria
    Elizarova, Tatiana
    COMPUTATIONAL SCIENCE, ICCS 2024, PT VII, 2024, 14838 : 85 - 99
  • [44] Implementation of Direct Binary Search and Error Diffusion Algorithm Using GPU
    Zhang, Jiajin
    Wei, Qun
    Chen, Lichang
    INTERNATIONAL CONFERENCE ON COMPUTATIONAL AND INFORMATION SCIENCES (ICCIS 2014), 2014, : 1163 - 1170
  • [45] An Efficient Graph Isomorphism Algorithm Based on Canonical Labeling and Its Parallel Implementation on GPU
    Wang, Renda
    Guo, Longjiang
    Ai, Chunyu
    Li, Jinbao
    Ren, Meirui
    Li, Keqin
    2013 IEEE 15TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2013 IEEE INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (HPCC_EUC), 2013, : 1089 - 1096
  • [46] Alarm Correlation Using Apriori Algorithm
    Sarkan, Mehmet Onur
    Akcakoca, Aysel
    Kucukakdag, Can
    Cataltepe, Zehra
    2015 23RD SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2015, : 1602 - 1605
  • [47] Efficient hardware data mining with the Apriori algorithm on FPGAs
    Baker, ZK
    Prasanna, VK
    FCCM 2005: 13TH ANNUAL IEEE SYMPOSIUM ON FIELD-PROGRAMMABLE CUSTOM COMPUTING MACHINES, PROCEEDINGS, 2005, : 3 - 12
  • [48] Memory Efficient Deployment of an Optical Flow Algorithm on GPU Using OpenMP
    Haggui, Olfa
    Tadonki, Claude
    Sayadi, Fatma
    Ouni, Bouraoui
    IMAGE ANALYSIS AND PROCESSING - ICIAP 2019, PT II, 2019, 11752 : 477 - 487
  • [49] TFI-Apriori: Using new encoding to optimize the apriori algorithm
    Ansari, Ebrahim
    Sadreddini, M. H.
    Mirsadeghi, S. M. H.
    Keshtkaran, Morteza
    Wallace, Richard
    INTELLIGENT DATA ANALYSIS, 2018, 22 (04) : 807 - 827
  • [50] Efficient Implementation of MrBayes on Multi-GPU
    Bao, Jie
    Xia, Hongju
    Zhou, Jianfu
    Liu, Xiaoguang
    Wang, Gang
    MOLECULAR BIOLOGY AND EVOLUTION, 2013, 30 (06) : 1471 - 1479