Big Data Analytics using Multi-Classifier Approach with RHadoop

被引:0
作者
Hiranandani, Priyanka [1 ]
Pilli, Emmanuel S. [2 ]
Chand, Nanak [3 ]
Ramakrishna, C. [3 ]
Gupta, Madhuri [2 ]
机构
[1] Bharat Petr Corp Ltd, ERPCC IIS, Mumbai, Maharashtra, India
[2] Malaviya Natl Inst Technol, Dept Comp Sci & Engn, Jaipur, Rajasthan, India
[3] Natl Inst Tech Teachers Training & Res, Dept Comp Sci & Engn, Chandigarh, India
来源
PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE CONFLUENCE 2018 ON CLOUD COMPUTING, DATA SCIENCE AND ENGINEERING | 2018年
关键词
BigData Analytics; Multi-Classifier; Naive Bayes; K-Nearest Neighbor; Decision Tree;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Big Data is the massive amount of data that is generated at such a high speed that is very difficult to analyze with traditional tools. Hadoop provides distributed storage and processing, to extract useful information from such huge data. On the other hand, R is open-source data analysis and programming language that facilitates statistical analysis and data visualization. But R is not scalable, it becomes difficult to process big data using R due to its memory limitations. To utilize data visualization, data transformation capabilities of R on Big Data, in this paper we have integrated R with Hadoop using RHadoop[] package and implemented map reduce form of K-Nearest Neighbor, Naive Bayes and Decision Tree Classifiers in R. In this paper we have also implemented Multi-Classifier to improve the accuracy of classification. Multi-Classifier combines the power of individual classifier to increase the eciency and accuracy of classfication. We have used Bayesian combinatorial function and majority voting to combine powers of the above mentioned classifiers. We have found that Multi-Classifier approach gives an improvement in parameters like precision, recall and accuracy.
引用
收藏
页码:478 / 484
页数:7
相关论文
共 18 条
  • [1] The k-Nearest Neighbor Algorithm Using MapReduce Paradigm
    Anchalia, Prajesh P.
    Roy, Kaushik
    [J]. PROCEEDINGS FIFTH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS, MODELLING AND SIMULATION, 2014, : 513 - 518
  • [2] [Anonymous], 2007, MULTIPLE CLASSIFIER
  • [3] [Anonymous], ARXIV14074908
  • [4] [Anonymous], 2017, The R Project for Statistical Computing
  • [5] [Anonymous], 2006, International Journal of Hybrid Intelligent Systems, DOI [10.3233/HIS-2006-3104, DOI 10.3233/HIS-2006-3104]
  • [6] Borji A, 2007, LECT NOTES COMPUT SC, V4846, P254
  • [7] BRADSKI G., 2007, NIPS, P281
  • [8] Dean J, 2004, USENIX ASSOCIATION PROCEEDINGS OF THE SIXTH SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION (OSDE '04), P137
  • [9] Dong S., 2012, J COMPUTATIONAL INFO, V8, P10429
  • [10] Rish I, 2001, IJCAI 2001 WORK EMPI, V3, DOI DOI 10.1002/9781118721957.CH4