An Optimized Strategy for Speculative Execution in a Heterogeneous environment

被引：0

作者：

Liu, Qi ^{[1
]}

Cai, Weidong ^{[1
]}

Fu, Zhangjie ^{[2
]}

Shen, Jian ^{[1
]}

Linge, Nigel ^{[3
]}

机构：

[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Jiangsu, Peoples R China

[2] Nanjing Univ Informat Sci & Technol, Jiangsu Engn Ctr Network Monitoring, Nanjing 210044, Jiangsu, Peoples R China

[3] Univ Salford, Salford M5 4WT, Greater Manches, England

来源：

2015 9TH INTERNATIONAL CONFERENCE ON FUTURE GENERATION COMMUNICATION AND NETWORKING (FGCN) | 2015年

关键词：

MAPREDUCE;

D O I：

10.1109/FGCN.2015.9

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

MapReduce is a popular programming model for the purposes of processing large data sets. Speculative execution known as an approach for dealing with the above problems works by backing up those tasks running on a low performance machine to a higher one. In this paper, we have modified some pitfalls and taken computer hardware into consideration (HWC-Speculation). We also have implemented it in Hadoop-2.6 and experiment results show that our method can assign tasks evenly, improve the performance of MRV2 and decrease the execution time.

引用

页码：9 / 12

页数：4

共 9 条

[1]

Ahmad F, 2012, ASPLOS XVII: SEVENTEENTH INTERNATIONAL CONFERENCE ON ARCHITECTURAL SUPPORT FOR PROGRAMMING LANGUAGES AND OPERATING SYSTEMS, P61

[2] A View of Cloud Computing [J].

Armbrust, Michael ;

Fox, Armando ;

Griffith, Rean ;

Joseph, Anthony D. ;

Katz, Randy ;

Konwinski, Andy ;

Lee, Gunho ;

Patterson, David ;

Rabkin, Ariel ;

Stoica, Ion ;

Zaharia, Matei .

COMMUNICATIONS OF THE ACM, 2010, 53 (04) :50-58

[3] Mapreduce: Simplified data processing on large clusters [J].

Dean, Jeffrey ;

Ghemawat, Sanjay .

COMMUNICATIONS OF THE ACM, 2008, 51 (01) :107-113

[4] Improving MapReduce Performance by Balancing Skewed Loads [J].

Fan Yuanquan ;

Wu Weiguo ;

Xu Yunlong ;

Chen Heng .

CHINA COMMUNICATIONS, 2014, 11 (08) :85-108

[5] Achieving Efficient Cloud Search Services: Multi-Keyword Ranked Search over Encrypted Cloud Data Supporting Parallel Computing [J].

Fu, Zhangjie ;

Sun, Xingming ;

Liu, Qi ;

Zhou, Lu ;

Shu, Jiangang .

IEICE TRANSACTIONS ON COMMUNICATIONS, 2015, E98B (01) :190-200

[6]

Gufler Benjamin, 2011, Proceedings of the 1st International Conference on Cloud Computing and Services Science. CLOSER 2011, P574

[7]

Kwon Y., 2012, SIGMOD 12, P25

[8]

Olston C., P ACM SIGMOD INT C M

[9] Cost-Effective Resource Provisioning for MapReduce in a Cloud [J].

Palanisamy, Balaji ;

Singh, Aameek ;

Liu, Ling .

IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2015, 26 (05) :1265-1279

← 1 →