A Bee Colony based optimization approach for simultaneous job scheduling and data replication in grid environments

被引:43
作者
Taheri, Javid [1 ]
Lee, Young Choon [1 ]
Zomaya, Albert Y. [1 ]
Siegel, Howard Jay [2 ,3 ]
机构
[1] Univ Sydney, Sch Informat Technol, Ctr Distributed & High Performance Comp, Sydney, NSW 2006, Australia
[2] Colorado State Univ, Dept Elect & Comp Engn, Ft Collins, CO 80523 USA
[3] Colorado State Univ, Dept Comp Sci, Ft Collins, CO 80523 USA
基金
澳大利亚研究理事会; 美国国家科学基金会;
关键词
Bee colony optimization; Data replication; Grid computing; Job scheduling; Resource allocation; FRAMEWORK; EXECUTION; ALGORITHM;
D O I
10.1016/j.cor.2011.11.012
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper presents a novel Bee Colony based optimization algorithm, named Job Data Scheduling using Bee Colony (JDS-BC). JDS-BC consists of two collaborating mechanisms to efficiently schedule jobs onto computational nodes and replicate datafiles on storage nodes in a system so that the two independent, and in many cases conflicting, objectives (i.e., makespan and total datafile transfer time) of such heterogeneous systems are concurrently minimized. Three benchmarks - varying from small- to large-sized instances - are used to test the performance of JDS-BC. Results are compared against other algorithms to show JDS-BC's superiority under different operating scenarios. These results also provide invaluable insights into data-centric job scheduling for grid environments. (C) 2011 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1564 / 1578
页数:15
相关论文
共 41 条
[1]  
Abdi S., 2010, INT J GRID COMPUTING, V1, P23
[2]  
Andreetto P, 2004, P C COMP HIGH EN NUC, P899
[3]  
Anjum A, 2006, IEEE T NUCL SCI, V53, P3818, DOI 10.1109/TNS.2006.886047
[4]   Utilizing widely distributed computational resources efficiently with execution domains [J].
Basney, J ;
Livny, M ;
Mazzanti, P .
COMPUTER PHYSICS COMMUNICATIONS, 2001, 140 (1-2) :246-252
[5]   OptorSim: A grid simulator for studying dynamic data replication strategies [J].
Bell, WH ;
Cameron, DG ;
Capozza, L ;
Millar, AP ;
Stockinger, K ;
Zini, F .
INTERNATIONAL JOURNAL OF HIGH PERFORMANCE COMPUTING APPLICATIONS, 2003, 17 (04) :403-416
[6]  
Berman F., 2003, GRID COMPUTING MAKIN
[7]  
Bitam S., 2010, Proceedings of the 2010 IEEE international symposium on parallel distributed processing, workshops and Phd forum (IPDPSW '10), P1, DOI DOI 10.1109/IPDPSW.2010.5470701
[8]  
Bode B, 2000, USENIX ASSOCIATION PROCEEDINGS OF THE 4TH ANNUAL LINUX SHOWCASE AND CONFERENCE, ATLANTA, P217
[9]  
Casanova H., 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556), P349, DOI 10.1109/HCW.2000.843757
[10]  
Chakrabarti A., 2005, LECT NOTES COMP SCI, V3296, P85