Execution Time Estimation for Workflow Scheduling

被引:13
作者
Chirkin, Artem M. [1 ,2 ]
Belloum, A. S. Z. [3 ]
Kovalchuk, Sergey V. [1 ]
Makkes, Marc X. [4 ]
机构
[1] ITMO Univ, Birzhevaya Line 4, St Petersburg 199034, Russia
[2] Univ Amsterdam, Amsterdam, Netherlands
[3] Univ Amsterdam, POB 94323, NL-1090 GH Amsterdam, Netherlands
[4] TNO Informat & Commun Technol, Amsterdam, Netherlands
来源
2014 9TH WORKSHOP ON WORKFLOWS IN SUPPORT OF LARGE-SCALE SCIENCE (WORKS) | 2014年
关键词
D O I
10.1109/WORKS.2014.11
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Estimation of the execution time is an important part of the workflow scheduling problem. The aim of this paper is to highlight common problems in estimating the workflow execution time and propose a solution that takes into account the complexity and the randomness of the workflow components and their runtime. The solution proposed in this paper addresses the problems at different levels from task to workflow, including the error measurement and the theory behind the estimation algorithm. The proposed estimation algorithm can be integrated easily into a wide class of schedulers as a separate module. We use a dual stochastic representation, characteristic / distribution functions, in order to combine tasks' estimates into the overall workflow makespan. Additionally, we propose the workflow reductions - the operations on a workflow graph that do not decrease the accuracy of the estimates, but simplify the graph structure, hence increasing the performance of the algorithm.
引用
收藏
页码:1 / 10
页数:10
相关论文
共 24 条
[1]  
Afzal A, 2006, GCC 2005: FIFTH INTERNATIONAL CONFERENCE ON GRID AND COOPERATIVE COMPUTING, PROCEEDINGS, P185
[2]  
Amalarethinam D.I.G., 2012, P INT C COMP COMM IN, P1
[3]  
Breiman L., 1999, TECH REP
[4]   An Ant Colony Optimization Approach to a Grid Workflow Scheduling Problem With Various QoS Requirements [J].
Chen, Wei-Neng ;
Zhang, Jun .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2009, 39 (01) :29-43
[5]  
Chirkin A., 2014, THESIS
[6]  
Falzon Geoffrey, 2009, Proceedings of the 2009 Fifth International Conference on Natural Computation (ICNC 2009), P227, DOI 10.1109/ICNC.2009.437
[7]   HCOC: a cost optimization algorithm for workflow scheduling in hybrid clouds [J].
Fernando Bittencourt, Luiz ;
Roberto Mauro Madeira, Edmundo .
JOURNAL OF INTERNET SERVICES AND APPLICATIONS, 2011, 2 :207-227
[8]  
Gutierrez-Garcia J. O., 2011, 2011 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery, P416, DOI 10.1109/CyberC.2011.74
[9]   Estimating the Optimal Configuration of a Multi-Core Cluster: A Preliminary Study [J].
Ichikawa, Shuichi ;
Takagi, Shoichiro .
CISIS: 2009 INTERNATIONAL CONFERENCE ON COMPLEX, INTELLIGENT AND SOFTWARE INTENSIVE SYSTEMS, VOLS 1 AND 2, 2009, :1245-1251
[10]   Optimizing process allocation of parallel programs for heterogeneous clusters [J].
Ichikawa, Shuichi ;
Takahashi, Sho ;
Kawai, Yuu .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2009, 21 (04) :475-507