Performance analysis of MapReduce program in heterogeneous cloud computing

被引：8
|
作者：
Lin, Wenhui [1 ,2 ]
Liu, Jun [1 ]
机构：
[1] Beijing Key Laboratory of Network System Architecture and Convergence, School of Information and Communication Engineering, Beijing University of Posts and Telecommunications
[2] Technology Research Institute, Aisino Corporation
来源：
Journal of Networks | 2013年 / 8卷 / 08期
关键词：
Benchmark; Cloud computing; Hadoop; Performance analysis;
D O I：
10.4304/jnw.8.8.1734-1741
中图分类号：
学科分类号：
摘要：
The research of Hadoop is an important part of cloud computing industry, and Hadoop performance research is a key research direction. The Hadoop performance analysis as a basic work can provide important reference for other performance optimization researches. In this paper, based on previous researches of server performance analysis, we propose a node performance measurement method on Hadoop. We describe in detail how to measure the performance value of each node in heterogeneous Hadoop cluster and evaluate measurement results by running MapReduce programs. Meanwhile, the method has also been implemented and evaluated in real-world Hadoop cluster. Experiment results show that the method can accurately measure the performance value of each node. Based on this research, users can have a comprehensive and objective understanding of their own Hadoop cluster and then make optimization and improvement on Hadoop. © 2013 ACADEMY PUBLISHER.
引用
收藏
页码：1734 / 1741
页数：7
相关论文
共 50 条
  • [1] Dynamic Token Based Improving MapReduce Performance in Cloud Computing
    Zhou, Mosong
    Chen, Heng
    Dong, Xiaoshe
    Zhu, Zhengdong
    PROCEEDINGS 2015 IEEE FIFTH INTERNATIONAL CONFERENCE ON BIG DATA AND CLOUD COMPUTING BDCLOUD 2015, 2015, : 180 - 186
  • [2] Cloud Computing for ECG Analysis Using MapReduce
    Wee, Kerk Chin
    Zahid, Mohd Soperi Mohd
    2015 4TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTER SCIENCE APPLICATIONS AND TECHNOLOGIES (ACSAT), 2015, : 115 - 120
  • [3] Cloud Computing: Performance Analysis of Load Balancing Algorithms in Cloud Heterogeneous Environment
    Behal, Veerawali
    Kumar, Anil
    2014 5TH INTERNATIONAL CONFERENCE CONFLUENCE THE NEXT GENERATION INFORMATION TECHNOLOGY SUMMIT (CONFLUENCE), 2014, : 200 - 205
  • [4] Performance Evaluation of MapReduce Applications on Cloud Computing Environment, FutureGrid
    Kang, Yunhee
    Fox, Geoffrey C.
    GRID AND DISTRIBUTED COMPUTING, 2011, 261 : 77 - +
  • [5] MapReduce Scheduling for Deadline-Constrained Jobs in Heterogeneous Cloud Computing Systems
    Chen, Chien-Hung
    Lin, Jenn-Wei
    Kuo, Sy-Yen
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2018, 6 (01) : 127 - 140
  • [6] A Survey on MapReduce Scheduling in Cloud Computing
    Liu, Li
    Zhai, YingQi
    2015 FIFTH INTERNATIONAL CONFERENCE ON INSTRUMENTATION AND MEASUREMENT, COMPUTER, COMMUNICATION AND CONTROL (IMCCC), 2015, : 1710 - 1715
  • [7] Achieving Accountable MapReduce in cloud computing
    Xiao, Zhifeng
    Xiao, Yang
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2014, 30 : 1 - 13
  • [8] Adaptive Combiner for MapReduce on cloud computing
    Huang, Tzu-Chi
    Chu, Kuo-Chih
    Lee, Wei-Tsong
    Ho, Yu-Sheng
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2014, 17 (04): : 1231 - 1252
  • [9] Adaptive Combiner for MapReduce on cloud computing
    Tzu-Chi Huang
    Kuo-Chih Chu
    Wei-Tsong Lee
    Yu-Sheng Ho
    Cluster Computing, 2014, 17 : 1231 - 1252
  • [10] Distributed Control Framework for MapReduce Cloud on Cloud Computing
    Huang, Tzu-Chi
    Chu, Kuo-Chih
    Huang, Guo-Hao
    Shen, Yan-Chen
    Shieh, Ce-Kuen
    NOMS 2018 - 2018 IEEE/IFIP NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM, 2018,
12345