A novel scheduling algorithm for data-intensive workflow in virtualised clouds

被引:0
作者
Li F. [1 ]
机构
[1] Department of Computer and Communications, Hunan Institute of Engineering, Hunan Province
关键词
Cloud computing; Task scheduling; Virtual machine; Workflow;
D O I
10.1504/ijnvo.2019.100182
中图分类号
学科分类号
摘要
In cloud platforms, workflow applications have been widely used to solve the complicated problems, which often need to process a large volume of data. However, the characteristic of data-intensive for these applications are easily to result in low execution efficiency due to networking traffic or congestion. In this paper, we present a workflow scheduling algorithm which is capable of minimising the cost of networking communication and therefore improving the execution efficiency of those workflow applications. Extensive experiments are conducted on some real-world workflows to examine the performance of the proposed algorithm, and the results show that it can significantly reduce the communication cost and improve the execution efficiency of data-intensive workflows comparing with existing algorithms. Copyright © 2019 Inderscience Enterprises Ltd.
引用
收藏
页码:284 / 300
页数:16
相关论文
共 43 条
[11]  
Costa A.M., Vargas P.A., Et al., Makespan minimization on parallel processors: An immune-based approach, Proceedings of Congress on Evolutionary Computation, pp. 920-925, (2002)
[12]  
Curran O., Shearer A., A workflow model for heterogeneous computing environments, Future Generation Computer Systems, 25, 4, pp. 414-425, (2009)
[13]  
Darbha S., Agrawal D.P., Optimal scheduling algorithm for distributed-memory machines, IEEE Transactions on Parallel and Distributed Systems, 9, 1, pp. 87-95, (1998)
[14]  
Esposito C., Ficco M., Et al., Interconnecting federated clouds by using publish-subscribe service, Cluster Computing, 16, 4, pp. 887-903, (2013)
[15]  
Farkas Z., Kacsuk P., P-GRADE portal: A generic workflow system to support user communities, Future Generation Computer Systems, 27, 5, pp. 454-465, (2011)
[16]  
Gomes E.R., Quoc Bao V., Et al., Pure exchange markets for resource sharing in federated clouds, Concurrency and Computation: Practice and Experience, 24, 9, pp. 977-991, (2012)
[17]  
Inacio E.C., Dantas M.A.R., A survey into performance and energy efficiency in HPC, cloud and big data environments, International Journal of Networking and Virtual Organisations, 14, 4, pp. 299-318, (2014)
[18]  
Keesookpun C., Mitomo H., Cloud computing adoption and determining factors in different industries: A case study of Thailand, International Journal of Information Technology and Management, 13, 4, pp. 243-263, (2014)
[19]  
Kumar V.S., Kurc T., Et al., Parameterized specification, configuration and execution of data-intensive scientific workflows, Cluster Computing, 13, 3, pp. 315-333, (2010)
[20]  
Lee K., Paton N.W., Et al., Utility functions for adaptively executing concurrent workflows, Concurrency and Computation: Practice & Experience, 23, 6, pp. 646-666, (2011)