Performance Enhancement of Hadoop MapReduce Framework for Analyzing BigData

被引：0

作者：

Prabhu, Swathi ^{[1
]}

Rodrigues, Anisha P. ^{[1
]}

Prasad, Guru M. S. ^{[2
]}

Nagesh, H. R. ^{[3
]}

机构：

[1] NMAMIT, Dept CSE, Nitte, India

[2] SDMIT, Dept CSE, Ujire, India

[3] MITE, Dept CSE, Moodabidri, India

来源：

2015 IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER AND COMMUNICATION TECHNOLOGIES | 2015年

关键词：

BigData; Hadoop; MapReduce; Peiformance; Baseline system;

D O I：

暂无

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

In this BigData era processing and analyzing the data is very important and tedious job. An open source framework called Hadoop, implementation of MapReduce provides efficient platform for BigData analytics. The performance of Hadoop MapReduce mainly depends on its configuration parameters. Tuning the job configuration parameters is an effective way to improve performance so that we can reduce the execution time and the disk utilization. The performance tuning mainly based on CPU usage, disk I/O rate, memory usage, network traffic components. In this paper we are discussing the tuning methods to enhance the performance of MapReduce jobs. From our experiment we can say that performance has improved by 32.97% over the baseline system.

引用

页数：7

共 50 条

[1] Hadoop MapReduce Performance on SSDs for Analyzing Social Networks
Bakratsas, M.
Basaras, P.
Katsaros, D.
Tassiulas, L.
BIG DATA RESEARCH, 2018, 11 : 1 - 10
[2] Analyzing BigData with Hadoop Cluster in HDInsight Azure Cloud
Bhardwaj, Aditya
Singh, Vineet Kumar
Choudhary, Vanraj
Narayan, Yogendra
2015 ANNUAL IEEE INDIA CONFERENCE (INDICON), 2015,
[3] AN APPROACH FOR STITCHING SATELLITE IMAGES IN A BIGDATA MAPREDUCE FRAMEWORK
Sari, H.
Eken, S.
Sayar, A.
4TH INTERNATIONAL GEOADVANCES WORKSHOP - GEOADVANCES 2017: ISPRS WORKSHOP ON MULTI-DIMENSIONAL & MULTI-SCALE SPATIAL DATA MODELING, 2017, 4-4 (W4): : 351 - 355
[4] Analyzing performance of Apache Tez and MapReduce with hadoop multinode cluster on Amazon cloud
Singh R.
Kaur P.J.
Journal of Big Data, 3 (1)
[5] Performance Comparison of Distributed Pattern Matching Algorithms on Hadoop MapReduce Framework
Sona, C. P.
Mulerikkal, Jaison Paul
MOBILE NETWORKS AND MANAGEMENT (MONAMI 2017), 2018, 235 : 45 - 55
[6] Framework for Analyzing Web Access Logs using Hadoop and MapReduce
Borgaonkar, Pranjali
Kumar, Gaurav
Yaduwanshi, Jyoti
2018 INTERNATIONAL CONFERENCE ON RECENT INNOVATIONS IN ELECTRICAL, ELECTRONICS & COMMUNICATION ENGINEERING (ICRIEECE 2018), 2018, : 2124 - 2129
[7] Straggler Mitigation in Hadoop MapReduce Framework: A Review
Ajibade, Lukuman Saheed
Abu Bakar, Kamalrulnizam
Aliyu, Ahmed
Danish, Tasneem
INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (08) : 870 - 878
[8] An Approach to Enhance the Performance of Hadoop MapReduce Framework for Big Data
Chandra, Subhash
Motwani, Deepak
2016 INTERNATIONAL CONFERENCE ON MICRO-ELECTRONICS AND TELECOMMUNICATION ENGINEERING (ICMETE), 2016, : 178 - 182
[9] Apache Hadoop-MapReduce on YARN framework latency
El Yazidi, Abdelaziz
Azizi, Mohamed Saad
Benlachmi, Yassine
Hasnaoui, Moulay Lahcen
12TH INTERNATIONAL CONFERENCE ON AMBIENT SYSTEMS, NETWORKS AND TECHNOLOGIES (ANT) / THE 4TH INTERNATIONAL CONFERENCE ON EMERGING DATA AND INDUSTRY 4.0 (EDI40) / AFFILIATED WORKSHOPS, 2021, 184 : 803 - 808
[10] Various approches to improve MapReduce performance in Hadoop
Manjaly, Jisha S.
Subbulakshmi, T.
PROCEEDINGS OF THE 2018 3RD INTERNATIONAL CONFERENCE ON INVENTIVE COMPUTATION TECHNOLOGIES (ICICT 2018), 2018, : 778 - 782

← 1 2 3 4 5 →