Challenges for Scheduling Scientific Workflows on Cloud Functions

被引:26
|
作者
Kijak, Joanna [1 ]
Martyna, Piotr [1 ]
Pawlik, Maciej [1 ]
Balis, Bartosz [1 ]
Malawski, Maciej [1 ]
机构
[1] AGH Univ Sci & Technol, Dept Comp Sci, Krakow, Poland
来源
PROCEEDINGS 2018 IEEE 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD) | 2018年
关键词
FaaS; serverless computing; cloud functions; scientific workflow; task scheduling;
D O I
10.1109/CLOUD.2018.00065
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Serverless computing, also known as Function-asa- Service (FaaS) or Cloud Functions, is a new method of running distributed applications by executing functions on the infrastructure of cloud providers. Although it frees the developers from managing servers, there are still decisions to be made regarding selection of function configurations based on the desired performance and cost. The billing model of this approach considers time of execution, measured in 100ms units, as well as the size of the memory allocated per function. In this paper, we look into the problem of scheduling scientific workflows, which are applications consisting of multiple tasks connected into a dependency graph. We discuss challenges related to workflow scheduling and propose the Serverless Deadline-Budget Workflow Scheduling (SDBWS) algorithm adapted to serverless platforms. We present preliminary experiments with a small-scale Montage workflow run on the AWS Lambda infrastructure.
引用
收藏
页码:460 / 467
页数:8
相关论文
共 50 条
  • [41] A parallel multi-objective genetic algorithm for scheduling scientific workflows in cloud computing
    Sardaraz, Muhammad
    Tahir, Muhammad
    INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2020, 16 (08)
  • [42] A Survey on Scheduling Workflows in Cloud Environment
    Ye, Xin
    Liang, Jiwei
    Liu, Sihao
    Li, Jia
    2015 INTERNATIONAL CONFERENCE ON NETWORK AND INFORMATION SYSTEMS FOR COMPUTERS (ICNISC), 2015, : 344 - 348
  • [43] Multi-Objective Scheduling for Scientific Workflows on Cloud with Peer-to-peer Clustering
    Wangsom, Peerasak
    Lavangnananda, Kittichai
    Bouvry, Pascal
    2019 11TH INTERNATIONAL CONFERENCE ON KNOWLEDGE AND SMART TECHNOLOGY (KST), 2019, : 175 - 180
  • [44] Smart PSO-based secured scheduling approaches for scientific workflows in cloud computing
    Sujana, J. Angela Jennifa
    Revathi, T.
    Priya, T. S. Siva
    Muneeswaran, K.
    SOFT COMPUTING, 2019, 23 (05) : 1745 - 1765
  • [45] GA-ETI: An enhanced genetic algorithm for the scheduling of scientific workflows in cloud environments
    Casas, Israel
    Taheri, Javid
    Ranjan, Rajiv
    Wang, Lizhe
    Zomaya, Albert Y.
    JOURNAL OF COMPUTATIONAL SCIENCE, 2018, 26 : 318 - 331
  • [46] An incremental reinforcement learning scheduling strategy for data-intensive scientific workflows in the cloud
    Nascimento, Andre
    Silva, Vitor
    Paes, Aline
    de Oliveira, Daniel
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (11):
  • [47] Fault Tolerant and Data Oriented Scientific Workflows Management and Scheduling System in Cloud Computing
    Ahmad, Zulfiqar
    Jehangiri, Ali Imran
    Mohamed, Nader
    Othman, Mohamed
    Umar, Arif Iqbal
    IEEE ACCESS, 2022, 10 : 77614 - 77632
  • [48] Structure-Aware Scheduling Algorithm for Deadline-Constrained Scientific Workflows in the Cloud
    Al-Haboobi, Ali
    Kecskemeti, Gabor
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (02) : 792 - 802
  • [49] Smart PSO-based secured scheduling approaches for scientific workflows in cloud computing
    J. Angela Jennifa Sujana
    T. Revathi
    T. S. Siva Priya
    K. Muneeswaran
    Soft Computing, 2019, 23 : 1745 - 1765
  • [50] Dynamic Execution of Scientific Workflows in Cloud
    Kail, E.
    Kovacs, J.
    Kozlovszky, M.
    Kacsuk, P.
    2016 39TH INTERNATIONAL CONVENTION ON INFORMATION AND COMMUNICATION TECHNOLOGY, ELECTRONICS AND MICROELECTRONICS (MIPRO), 2016, : 332 - 336