Scheduling multiple scientific workflows using containers on IaaS cloud

被引:10
作者
Rajasekar, P. [1 ]
Palanichamy, Yogesh [1 ]
机构
[1] Anna Univ, Coll Engn, Dept Informat Sci & Technol, Chennai, Tamil Nadu, India
关键词
Cloud computing; Workflow as a service; Scheduling; Resource provisioning; Deadline and cost minimization; AS-A-SERVICE; ALGORITHMS; SIMULATION; DRIVEN;
D O I
10.1007/s12652-020-02483-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the adaptable paradigm of cloud computing and obtainable of data accumulated from largely high-powered scientific devices, workflows have turn into an occurring aim to execute considerable scientific advances at an enhanced speed. Occurring Workflow as a Service (WaaS) frameworks provide scientists an effortless, simply accessible and cost-efficient manner of using their applications from anywhere and at anytime in the cloud. They are multitenant platforms and are developed to handle the execution of heterogeneous workflows continuous workload. To fulfill this, they utilize the compute, network and storage services provided by Infrastructure as a Service (IaaS) vendors. Therefore, at any considerable particular moment, a WaaS framework should be proficient of effectively schedule these continuous workload of workflows with various features and quality of service (QoS). Therefore, we propose a strategy of scheduling and resource provisioning planned particularly for WaaS platforms. The algorithm is dynamic and scalable to adjust to improve in the workload and platform. It supports containers to deal the inefficiency of resource utilization and targets to reduce the overall execution cost of infrastructure resources as fulfilling each single workflow deadline constraint. To our information, this approach that explicitly deals VM sharing in the subject of WaaS by devising the utilization of containers in the heuristics of scheduling and resource provisioning. Our experimental results shows its responsiveness to the uncertainties of the environment, its potential to achieve deadlines, and its cost-effectiveness when compared to other recent algorithms.
引用
收藏
页码:7621 / 7636
页数:16
相关论文
共 50 条
[1]   Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service Clouds [J].
Abrishami, Saeid ;
Naghibzadeh, Mahmoud ;
Epema, Dick H. J. .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2013, 29 (01) :158-169
[2]  
[Anonymous], 2008, IGARSS 2008 2008 IEE, DOI DOI 10.1109/IGARSS.2008.4779913
[3]   Storage-aware Algorithms for Scheduling of Workflow Ensembles in Clouds [J].
Bryk, Piotr ;
Malawski, Maciej ;
Juve, Gideon ;
Deelman, Ewa .
JOURNAL OF GRID COMPUTING, 2016, 14 (02) :359-378
[4]   Meeting Deadlines of Scientific Workflows in Public Clouds with Tasks Replication [J].
Calheiros, Rodrigo N. ;
Buyya, Rajkumar .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2014, 25 (07) :1787-1796
[5]   CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms [J].
Calheiros, Rodrigo N. ;
Ranjan, Rajiv ;
Beloglazov, Anton ;
De Rose, Cesar A. F. ;
Buyya, Rajkumar .
SOFTWARE-PRACTICE & EXPERIENCE, 2011, 41 (01) :23-50
[6]   Task scheduling based on swarm intelligence algorithms in high performance computing environment [J].
Chai, Xuqing .
JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2020, 14 (11) :14807-14815
[7]   Adaptive multiple-workflow scheduling with task rearrangement [J].
Chen, Wei ;
Lee, Young Choon ;
Fekete, Alan ;
Zomaya, Albert Y. .
JOURNAL OF SUPERCOMPUTING, 2015, 71 (04) :1297-1317
[8]   Performance-aware energy-efficient parallel job scheduling in HPC grid using nature-inspired hybrid meta-heuristics [J].
Chhabra, Amit ;
Singh, Gurvinder ;
Kahlon, Karanjeet Singh .
JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 12 (02) :1801-1835
[9]   CCA: a deadline-constrained workflow scheduling algorithm for multicore resources on the cloud [J].
Deldari, Arash ;
Naghibzadeh, Mahmoud ;
Abrishami, Saeid .
JOURNAL OF SUPERCOMPUTING, 2017, 73 (02) :756-781
[10]   The impact of Docker containers on the performance of genomic pipelines [J].
Di Tommaso, Paolo ;
Palumbo, Emilio ;
Chatzou, Maria ;
Prieto, Pablo ;
Heuer, Michael L. ;
Notredame, Cedric .
PEERJ, 2015, 3