Algorithms for scheduling scientific workflows on serverless architecture

被引:10
作者
Majewski, Marcin [1 ]
Pawlik, Maciej [1 ]
Malawski, Maciej [1 ]
机构
[1] AGH Univ Sci & Technol, Inst Comp Sci, Krakow, Poland
来源
21ST IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING (CCGRID 2021) | 2021年
关键词
Serverless; Cloud functions; Algorithm; Scheduling; Workflow;
D O I
10.1109/CCGrid51090.2021.00095
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Serverless computing is a novel cloud computing paradigm where the cloud provider manages the underlying infrastructure, while users are only required to upload the code of the application. Function as a Service (FaaS) is a serverless computing model where short-lived methods are executed in the cloud. One of the promising use cases for FaaS is running scientific workflow applications, which represent a scientific process composed of related tasks. Due to the distinctive features of FaaS, which include rapid resource provisioning, indirect infrastructure management, and fine-grained billing model a need arises to create dedicated scheduling methods to effectively use the novel infrastructures as an environment for workflow applications. In this paper we propose two novel scheduling algorithms SMOHEFT and SML, which are designed to create a schedule for executing scientific workflows on serverless infrastructures concerning time and cost constraints. We evaluated proposed algorithms by performing experiments, where we planned the execution of three applications: Ellipsoids, Vina and Montage. SDBWS and SDBCS algorithms were used as a baseline. SML achieved the best results when executing Ellipsoids workflow, with a success rate above 80%, while other algorithms were below 60%. In the case of Vina, all the algorithms, except SDBWS, had a success rate above 87.5% and in the case of Montage, the success rate of all algorithms was similar, over 87.5%. The proposed algorithms' success rate is comparable or better than offered by other studied solutions.
引用
收藏
页码:782 / 789
页数:8
相关论文
共 14 条
[1]   A Survey on Scheduling Strategies for Workflows in Cloud Environment and Emerging Trends [J].
Adhikari, Mainak ;
Amgoth, Tarachand ;
Srirama, Satish Narayana .
ACM COMPUTING SURVEYS, 2019, 52 (04)
[2]   HyperFlow: A model of computation, programming approach and enactment engine for complex distributed workflows [J].
Balis, Bartosz .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2016, 55 :147-162
[3]  
Banach P., 2019, THESIS AGH U SCI TEC
[4]  
Bargiel M., 2015, CGW WORKSH 15 P OCT, P117
[5]  
Bargiel M, 2008, LECT NOTES COMPUT SC, V5102, P126, DOI 10.1007/978-3-540-69387-1_14
[6]  
Blattner M., 2009, ARXIV0908
[7]   A fast and elitist multiobjective genetic algorithm: NSGA-II [J].
Deb, K ;
Pratap, A ;
Agarwal, S ;
Meyarivan, T .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2002, 6 (02) :182-197
[8]  
Durillo JJ, 2012, INT CONF CLOUD COMP
[9]   ZINC - A free database of commercially available compounds for virtual screening [J].
Irwin, JJ ;
Shoichet, BK .
JOURNAL OF CHEMICAL INFORMATION AND MODELING, 2005, 45 (01) :177-182
[10]   Challenges for Scheduling Scientific Workflows on Cloud Functions [J].
Kijak, Joanna ;
Martyna, Piotr ;
Pawlik, Maciej ;
Balis, Bartosz ;
Malawski, Maciej .
PROCEEDINGS 2018 IEEE 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD), 2018, :460-467