Challenges for Scheduling Scientific Workflows on Cloud Functions

被引:26
|
作者
Kijak, Joanna [1 ]
Martyna, Piotr [1 ]
Pawlik, Maciej [1 ]
Balis, Bartosz [1 ]
Malawski, Maciej [1 ]
机构
[1] AGH Univ Sci & Technol, Dept Comp Sci, Krakow, Poland
来源
PROCEEDINGS 2018 IEEE 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD) | 2018年
关键词
FaaS; serverless computing; cloud functions; scientific workflow; task scheduling;
D O I
10.1109/CLOUD.2018.00065
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Serverless computing, also known as Function-asa- Service (FaaS) or Cloud Functions, is a new method of running distributed applications by executing functions on the infrastructure of cloud providers. Although it frees the developers from managing servers, there are still decisions to be made regarding selection of function configurations based on the desired performance and cost. The billing model of this approach considers time of execution, measured in 100ms units, as well as the size of the memory allocated per function. In this paper, we look into the problem of scheduling scientific workflows, which are applications consisting of multiple tasks connected into a dependency graph. We discuss challenges related to workflow scheduling and propose the Serverless Deadline-Budget Workflow Scheduling (SDBWS) algorithm adapted to serverless platforms. We present preliminary experiments with a small-scale Montage workflow run on the AWS Lambda infrastructure.
引用
收藏
页码:460 / 467
页数:8
相关论文
共 50 条
  • [1] Scientific Workflows Management and Scheduling in Cloud Computing: Taxonomy, Prospects, and Challenges
    Ahmad, Zulfiqar
    Jehangiri, Ali Imran
    Ala'anzy, Mohammed Alaa
    Othman, Mohamed
    Latip, Rohaya
    Zaman, Sardar Khaliq Uz
    Umar, Arif Iqbal
    IEEE ACCESS, 2021, 9 : 53491 - 53508
  • [2] Scheduling Architectures for Scientific Workflows in the Cloud
    Erbel, Johannes
    Korte, Fabian
    Grabowski, Jens
    SYSTEM ANALYSIS AND MODELING: LANGUAGES, METHODS, AND TOOLS FOR SYSTEMS ENGINEERING, SAM 2018, 2018, 11150 : 20 - 28
  • [3] Secure Scheduling of Scientific Workflows in Cloud
    Roy, Shubhro
    Ramamurthy, Arun
    Pawar, Anand
    Gharote, Mangesh
    Lodha, Sachin
    PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND SERVICES SCIENCE (CLOSER), 2022, : 170 - 177
  • [4] A Unified Mechanism for Cloud Scheduling of Scientific Workflows
    Kamran, Ali
    Farooq, Umar
    Rabbi, Ihsan
    Zia, Kashif
    Assam, Muhammad
    Alsolai, Hadeel
    Al-Wesabi, Fahd N.
    IEEE ACCESS, 2022, 10 : 71233 - 71246
  • [5] Energy Efficient Scheduling of Scientific Workflows in Cloud Environment
    Ghose, Manojit
    Verma, Pratyush
    Karmakar, Sushanta
    Sahu, Aryabartta
    2017 19TH IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS (HPCC) / 2017 15TH IEEE INTERNATIONAL CONFERENCE ON SMART CITY (SMARTCITY) / 2017 3RD IEEE INTERNATIONAL CONFERENCE ON DATA SCIENCE AND SYSTEMS (DSS), 2017, : 170 - 177
  • [6] A Hybrid Algorithm for Scheduling Scientific Workflows in Cloud Computing
    Sardaraz, Muhammad
    Tahir, Muhammad
    IEEE ACCESS, 2019, 7 : 186137 - 186146
  • [7] Optimal Workflow Scheduling for Scientific Workflows in Cloud Computing
    Agarkhed, Jayashree
    Ashalatha, R.
    IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGICAL TRENDS IN COMPUTING, COMMUNICATIONS AND ELECTRICAL ENGINEERING (ICETT), 2016,
  • [8] Structure-Aware Scheduling Methods for Scientific Workflows in Cloud
    Albtoush, Alaa
    Yunus, Farizah
    Almi'ani, Khaled
    Noor, Noor Maizura Mohamad
    APPLIED SCIENCES-BASEL, 2023, 13 (03):
  • [9] Fair-Share Methods for Scheduling Scientific Workflows in Cloud
    Aldabaybah, Balqees
    Alrawashdeh, Tawfiq
    Butt, Talal Ashraf
    Almiani, Khaled
    2023 20TH ACS/IEEE INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS AND APPLICATIONS, AICCSA, 2023,
  • [10] A Budget-Aware algorithm for Scheduling Scientific Workflows in Cloud
    Arabnejad, Vahid
    Bubendorfer, Kris
    Ng, Bryan
    PROCEEDINGS OF 2016 IEEE 18TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS; IEEE 14TH INTERNATIONAL CONFERENCE ON SMART CITY; IEEE 2ND INTERNATIONAL CONFERENCE ON DATA SCIENCE AND SYSTEMS (HPCC/SMARTCITY/DSS), 2016, : 1188 - 1195