Performance Analysis Using Petri Net Based MapReduce Model in Heterogeneous Clusters

被引：2

作者：

Cheng, Sheng-Tzong ^{[1
]}

Wang, Hsi-Chuan ^{[1
]}

Chen, Yin-Jun ^{[1
]}

Chen, Chen-Fei ^{[2
]}

机构：

[1] Natl Cheng Kung Univ, Dept Comp Sci & Informat Engn, Tainan 70101, Taiwan

[2] Shih Hsin Univ, Dept Informat & Communicat, Taipei, Taiwan

来源：

ADVANCES IN WEB-BASED LEARNING | 2015年 / 8390卷

关键词：

Cloud computing; MapReduce; Petri net; Performance analysis;

D O I：

10.1007/978-3-662-46315-4_18

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Currently, big data and large-scale data processing techniques has become an important developing area. MapReduce is an enabling technology of cloud computing. Hadoop is one of the most popular MapReduce implementation, which is the target platform in this paper. When running a MapReduce job, programmers however cannot acquire the information about how to fine-tune the parameters of application. Moreover, programmers need much time on finding the most suitable parameters. This paper evaluates execution processes in MapReduce and form SPN-MR model with Stochastic Petri Net. In order to analyze the performance of SPN-MR, formulas of mean delay time in each time transition are defined. SPN-MR simulates the elapsed time of any MapReduce jobs with known input data sizes and then reduces time cost in performance tuning. SPN-MR carried out several actual test benchmarks. The results showed the average error rate is within 5 percent. Therefore, it can provide effective performance evaluation reports for MapReduce programmers.

引用

页码：170 / 179

页数：10

共 14 条

[1]

Dean J, 2004, USENIX ASSOCIATION PROCEEDINGS OF THE SIXTH SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION (OSDE '04), P137

[2]

DINGLE NJ, 2009, ACM SIGMETRICS PERFO, V36, P34, DOI DOI 10.1145/1530873.1530881

[3] A PETRI NET APPROACH FOR PERFORMANCE ORIENTED PARALLEL PROGRAM DESIGN [J].

FERSCHA, A .

JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 1992, 15 (03) :188-206

[4]

Ganapathi A., 2010, IEEE 26 INT C DAT EN

[5] Performance Analysis of Cloud Computing Centers Using M/G/m/m plus r Queuing Systems [J].

Khazaei, Hamzeh ;

Misic, Jelena ;

Misic, Vojislav B. .

IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2012, 23 (05) :936-943

[6] HSim: A MapReduce simulator in enabling Cloud Computing [J].

Liu, Yang ;

Li, Maozhen ;

Alham, Nasullah Khalid ;

Hammoud, Suhel .

FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2013, 29 (01) :300-308

[7]

MARSAN MA, 1984, ACM T COMPUT SYST, V2, P93, DOI 10.1145/190.191

[8] PETRI NETS - PROPERTIES, ANALYSIS AND APPLICATIONS [J].

MURATA, T .

PROCEEDINGS OF THE IEEE, 1989, 77 (04) :541-580

[9]

Saavedra-Barrera R. H, 1990, 2 ANN ACM S PAR ALG

[10]

Tian F, 2011, IEEE INT C CLOUD COM

← 1 2 →