Performance analysis of MapReduce program in heterogeneous cloud computing

被引：8
作者：
Lin, Wenhui [1 ,2 ]
Liu, Jun [1 ]
机构：
[1] Beijing Key Laboratory of Network System Architecture and Convergence, School of Information and Communication Engineering, Beijing University of Posts and Telecommunications
[2] Technology Research Institute, Aisino Corporation
来源：
Journal of Networks | 2013年 / 8卷 / 08期
关键词：
Benchmark; Cloud computing; Hadoop; Performance analysis;
D O I：
10.4304/jnw.8.8.1734-1741
中图分类号：
学科分类号：
摘要：
The research of Hadoop is an important part of cloud computing industry, and Hadoop performance research is a key research direction. The Hadoop performance analysis as a basic work can provide important reference for other performance optimization researches. In this paper, based on previous researches of server performance analysis, we propose a node performance measurement method on Hadoop. We describe in detail how to measure the performance value of each node in heterogeneous Hadoop cluster and evaluate measurement results by running MapReduce programs. Meanwhile, the method has also been implemented and evaluated in real-world Hadoop cluster. Experiment results show that the method can accurately measure the performance value of each node. Based on this research, users can have a comprehensive and objective understanding of their own Hadoop cluster and then make optimization and improvement on Hadoop. © 2013 ACADEMY PUBLISHER.
引用
收藏
页码：1734 / 1741
页数：7
相关论文
共 50 条
  • [31] Parallel computing in bioinformatics: a view from high-performance, heterogeneous, and cloud computing
    Vega-Rodriguez, Miguel A.
    Santander-Jimenez, Sergio
    JOURNAL OF SUPERCOMPUTING, 2019, 75 (07) : 3369 - 3373
  • [32] Parallel computing in bioinformatics: a view from high-performance, heterogeneous, and cloud computing
    Miguel A. Vega-Rodríguez
    Sergio Santander-Jiménez
    The Journal of Supercomputing, 2019, 75 : 3369 - 3373
  • [33] Performance analysis based resource allocation for green cloud computing
    Lee, Hwa Min
    Jeong, Young-Sik
    Jang, Haeng Jin
    JOURNAL OF SUPERCOMPUTING, 2014, 69 (03) : 1013 - 1026
  • [34] Comparative Analysis on the Performance of Selected Security Algorithms in Cloud Computing
    Cordova, Ronald S.
    Maata, Rolou Lyn R.
    Halibas, Alrence S.
    Al-Azawi, Rula
    2017 INTERNATIONAL CONFERENCE ON ELECTRICAL AND COMPUTING TECHNOLOGIES AND APPLICATIONS (ICECTA), 2017, : 274 - 277
  • [35] Performance analysis based resource allocation for green cloud computing
    Hwa Min Lee
    Young-Sik Jeong
    Haeng Jin Jang
    The Journal of Supercomputing, 2014, 69 : 1013 - 1026
  • [36] Performance analysis of a CNN counting application for Fog and Cloud Computing
    Loja, Nancy
    Rivas, Wilmer
    Heredia, Andres
    Barros, Gabriel
    2019 XLV LATIN AMERICAN COMPUTING CONFERENCE (CLEI 2019), 2019,
  • [37] Performance Analysis for Heterogeneous Cloud Servers Using Queueing Theory
    Wang, Shuang
    Li, Xiaoping
    Ruiz, Ruben
    IEEE TRANSACTIONS ON COMPUTERS, 2020, 69 (04) : 563 - 576
  • [38] Service Performance Analysis of Cloud Computing Server by Queuing System
    Wang, Ruijuan
    Zai, Guangjun
    Liu, Yan
    Pang, Haibo
    MOBILE COMPUTING, APPLICATIONS, AND SERVICES, MOBICASE 2021, 2022, 434 : 42 - 53
  • [39] Performance Analysis of Hadoop MapReduce on an OpenNebula Cloud with KVM and OpenVZ Virtualizations
    Magalhaes Vasconcelos, Pedro Roger
    de Araujo Freitas, Gisele Azevedo
    2014 9TH INTERNATIONAL CONFERENCE FOR INTERNET TECHNOLOGY AND SECURED TRANSACTIONS (ICITST), 2014, : 471 - 476
  • [40] MapReduce for Scientific Computing
    Jakovits, Pelle
    Srirama, Satish Narayan
    Vainikko, Eero
    APPLICATIONS, TOOLS AND TECHNIQUES ON THE ROAD TO EXASCALE COMPUTING, 2012, 22 : 117 - 124
12345