A novel scheduling algorithm for data-intensive workflow in virtualised clouds

被引:0
作者
Li F. [1 ]
机构
[1] Department of Computer and Communications, Hunan Institute of Engineering, Hunan Province
关键词
Cloud computing; Task scheduling; Virtual machine; Workflow;
D O I
10.1504/ijnvo.2019.100182
中图分类号
学科分类号
摘要
In cloud platforms, workflow applications have been widely used to solve the complicated problems, which often need to process a large volume of data. However, the characteristic of data-intensive for these applications are easily to result in low execution efficiency due to networking traffic or congestion. In this paper, we present a workflow scheduling algorithm which is capable of minimising the cost of networking communication and therefore improving the execution efficiency of those workflow applications. Extensive experiments are conducted on some real-world workflows to examine the performance of the proposed algorithm, and the results show that it can significantly reduce the communication cost and improve the execution efficiency of data-intensive workflows comparing with existing algorithms. Copyright © 2019 Inderscience Enterprises Ltd.
引用
收藏
页码:284 / 300
页数:16
相关论文
共 43 条
[1]  
Adabi S., Movaghar A., Et al., Bi-level fuzzy based advanced reservation of cloud workflow applications on distributed grid resources, Journal of Supercomputing, 67, 1, pp. 175-218, (2014)
[2]  
Ahmad I., Kwok Y.K., On exploiting task duplication in parallel program scheduling, IEEE Transactions on Parallel and Distributed Systems, 9, 9, pp. 872-892, (1998)
[3]  
Allen G., Bogden P., Et al., Towards an integrated GIS-based coastal forecast workflow, Concurrency and Computation-Practice & Experience, 20, 14, pp. 1637-1651, (2008)
[4]  
Bozdag D., Catalyurek U., Ozguner F., A task duplication based bottom-up scheduling algorithm for heterogeneous environments, Proceedings of International Parallel and Distributed Processing Symposium, pp. 1-11, (2005)
[5]  
Cao H., Jin H., Et al., DAGMap: Efficient and dependable scheduling of DAG workflow job in grid, Journal of Supercomputing, 51, 2, pp. 201-223, (2010)
[6]  
Celesti A., Fazio M., Et al., Virtual machine provisioning through satellite communications in federated cloud environments, Future Generation Computer Systems, 28, 1, pp. 85-93, (2012)
[7]  
Cerezo N., Montagnat J., Et al., Computer-assisted scientific workflow design, Journal of Grid Computing, 11, 3, pp. 585-612, (2013)
[8]  
Chiang C.W., Lee Y.C., Et al., Ant colony optimisation for task matching and scheduling, IEE Proceedings of Computers and Digital Techniques, 153, 6, pp. 373-380, (2006)
[9]  
Chiang R.C., Huang H.H., TRACON: Interference-aware scheduling for data-intensive applications in virtualized environments, IEEE Transactions on Parallel and Distributed Systems, 25, 5, pp. 1349-1358, (2014)
[10]  
Cicotti G., Coppolino L., Et al., How to monitor QoS in cloud infrastructures: The QoSMONaaS approach, International Journal of Computational Science and Engineering, 11, 1, pp. 29-45, (2015)