Challenges for Scheduling Scientific Workflows on Cloud Functions

被引:26
|
作者
Kijak, Joanna [1 ]
Martyna, Piotr [1 ]
Pawlik, Maciej [1 ]
Balis, Bartosz [1 ]
Malawski, Maciej [1 ]
机构
[1] AGH Univ Sci & Technol, Dept Comp Sci, Krakow, Poland
来源
PROCEEDINGS 2018 IEEE 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD) | 2018年
关键词
FaaS; serverless computing; cloud functions; scientific workflow; task scheduling;
D O I
10.1109/CLOUD.2018.00065
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Serverless computing, also known as Function-asa- Service (FaaS) or Cloud Functions, is a new method of running distributed applications by executing functions on the infrastructure of cloud providers. Although it frees the developers from managing servers, there are still decisions to be made regarding selection of function configurations based on the desired performance and cost. The billing model of this approach considers time of execution, measured in 100ms units, as well as the size of the memory allocated per function. In this paper, we look into the problem of scheduling scientific workflows, which are applications consisting of multiple tasks connected into a dependency graph. We discuss challenges related to workflow scheduling and propose the Serverless Deadline-Budget Workflow Scheduling (SDBWS) algorithm adapted to serverless platforms. We present preliminary experiments with a small-scale Montage workflow run on the AWS Lambda infrastructure.
引用
收藏
页码:460 / 467
页数:8
相关论文
共 50 条
  • [31] A taxonomy and survey on scheduling algorithms for scientific workflows in IaaS cloud computing environments
    Rodriguez, Maria Alejandra
    Buyya, Rajkumar
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2017, 29 (08):
  • [32] Budget-deadline constrained approach for scientific workflows scheduling in a cloud environment
    Zhou, Naqin
    Lin, Weiwei
    Feng, Wei
    Shi, Fang
    Pang, Xiongwen
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2023, 26 (03): : 1737 - 1751
  • [33] Budget-deadline constrained approach for scientific workflows scheduling in a cloud environment
    Naqin Zhou
    Weiwei Lin
    Wei Feng
    Fang Shi
    Xiongwen Pang
    Cluster Computing, 2023, 26 : 1737 - 1751
  • [34] PSO+LOA: hybrid constrained optimization for scheduling scientific workflows in the cloud
    Huifang Li
    Danjing Wang
    Julio Ruben Cañizares Abreu
    Qing Zhao
    Orlando Bonilla Pineda
    The Journal of Supercomputing, 2021, 77 : 13139 - 13165
  • [35] Elastic Scheduling of Scientific Workflows under Deadline Constraints in Cloud Computing Environments
    Anwar, Nazia
    Deng, Huifang
    FUTURE INTERNET, 2018, 10 (01)
  • [36] PSO plus LOA: hybrid constrained optimization for scheduling scientific workflows in the cloud
    Li, Huifang
    Wang, Danjing
    Canizares Abreu, Julio Ruben
    Zhao, Qing
    Bonilla Pineda, Orlando
    JOURNAL OF SUPERCOMPUTING, 2021, 77 (11): : 13139 - 13165
  • [37] Examining the challenges of scientific workflows
    Gil, Yolanda
    Deelman, Ewa
    Ellisman, Mark
    Fahringer, Thomas
    Fox, Geoffrey
    Gannon, Dennis
    Goble, Carole
    Livny, Miron
    Moreau, Luc
    Myers, Jim
    COMPUTER, 2007, 40 (12) : 24 - +
  • [38] Budget-based resource provisioning and scheduling algorithm for scientific workflows on IaaS cloud
    Rajasekar P
    Santhiya P
    Multimedia Tools and Applications, 2024, 83 : 50981 - 51007
  • [39] Scheduling of Scientific Workflows on Data Grids
    Pandey, Suraj
    Buyya, Rajkumar
    CCGRID 2008: EIGHTH IEEE INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID, VOLS 1 AND 2, PROCEEDINGS, 2008, : 548 - 553
  • [40] Budget-based resource provisioning and scheduling algorithm for scientific workflows on IaaS cloud
    Rajasekar, P.
    Santhiya, P.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (17) : 50981 - 51007