Performance Enhancement of Hadoop MapReduce Framework for Analyzing BigData

被引：0
|
作者：
Prabhu, Swathi [1 ]
Rodrigues, Anisha P. [1 ]
Prasad, Guru M. S. [2 ]
Nagesh, H. R. [3 ]
机构：
[1] NMAMIT, Dept CSE, Nitte, India
[2] SDMIT, Dept CSE, Ujire, India
[3] MITE, Dept CSE, Moodabidri, India
来源：
2015 IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER AND COMMUNICATION TECHNOLOGIES | 2015年
关键词：
BigData; Hadoop; MapReduce; Peiformance; Baseline system;
D O I：
暂无
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
In this BigData era processing and analyzing the data is very important and tedious job. An open source framework called Hadoop, implementation of MapReduce provides efficient platform for BigData analytics. The performance of Hadoop MapReduce mainly depends on its configuration parameters. Tuning the job configuration parameters is an effective way to improve performance so that we can reduce the execution time and the disk utilization. The performance tuning mainly based on CPU usage, disk I/O rate, memory usage, network traffic components. In this paper we are discussing the tuning methods to enhance the performance of MapReduce jobs. From our experiment we can say that performance has improved by 32.97% over the baseline system.
引用
收藏
页数：7
相关论文
共 50 条
  • [31] Noninvasive MapReduce Performance Tuning Using Multiple Tuning Methods on Hadoop
    Chen, Donghua
    Zhang, Runtong
    Qiu, Robin Guanghua
    IEEE SYSTEMS JOURNAL, 2021, 15 (02): : 2906 - 2917
  • [32] Improving Hadoop MapReduce performance on heterogeneous single board computer clusters☆
    Lim, Sooyoung
    Park, Dongchul
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 160 : 752 - 766
  • [33] Performance optimization of MapReduce-based Apriori algorithm on Hadoop cluster
    Singh, Sudhakar
    Garg, Rakhi
    Mishra, P. K.
    COMPUTERS & ELECTRICAL ENGINEERING, 2018, 67 : 348 - 364
  • [34] A Survey on Recommendation System for Bigdata using MapReduce Technology
    Dhamecha, Maulik
    Dobaria, Krupa
    Patalia, Tejas
    PROCEEDINGS OF THE 2019 3RD INTERNATIONAL CONFERENCE ON COMPUTING METHODOLOGIES AND COMMUNICATION (ICCMC 2019), 2019, : 54 - 58
  • [35] Performance Analysis of Matrix and Graph Computations using Data Compression Techniques in MPI and Hadoop MapReduce in Big Data Framework
    Ramakrishnaiah, Nagendla
    Reddy, Sirigiri Konda
    2017 IEEE INTERNATIONAL CONFERENCE ON SMART TECHNOLOGIES AND MANAGEMENT FOR COMPUTING, COMMUNICATION, CONTROLS, ENERGY AND MATERIALS (ICSTM), 2017, : 54 - 62
  • [36] TaskTracker Aware Scheduling for Hadoop MapReduce
    Manjaly, Jisha S.
    Chooralil, Varghese S.
    2013 THIRD INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING AND COMMUNICATIONS (ICACC 2013), 2013, : 278 - 281
  • [37] Analyzing fault tolerance mechanism of Hadoop Mapreduce under different type of failures
    Yassir, Samadi
    Mostapha, Zbakh
    Tadonki, Claude
    2018 4TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING TECHNOLOGIES AND APPLICATIONS (CLOUDTECH), 2018,
  • [38] A Scalable Product Recommendations using Collaborative Filtering in Hadoop for Bigdata
    Riyaz, P. A.
    Varghese, Surekha Mariam
    INTERNATIONAL CONFERENCE ON EMERGING TRENDS IN ENGINEERING, SCIENCE AND TECHNOLOGY (ICETEST - 2015), 2016, 24 : 1393 - 1399
  • [39] Hadoop framework implementation and performance analysis on a cloud
    Ozen, Goksu Zekiye
    Tekerek, Mehmet
    Sultanov, Rayimbek
    TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2017, 25 (02) : 705 - 716
  • [40] Research on Power System Harmonic Detection based on Hadoop MapReduce Framework
    Chen Wenjuan
    Chen Shihua
    Wang Zheqiang
    Li Mengjie
    Zhou Yuan
    2018 CHINA INTERNATIONAL CONFERENCE ON ELECTRICITY DISTRIBUTION (CICED), 2018, : 431 - 435
12345