A hybrid bi-objective scheduling algorithm for execution of scientific workflows on cloud platforms with execution time and reliability approach

被引:37
作者
Alaie, Yeganeh Asghari [1 ]
Shirvani, Mirsaeid Hosseini [1 ]
Rahmani, Amir Masoud [2 ]
机构
[1] Islamic Azad Univ, Dept Comp Engn, Sari Branch, Sari, Iran
[2] Natl Yunlin Univ Sci & Technol, Future Technol Res Ctr, Touliu, Yunlin, Taiwan
关键词
Workflow scheduling; Hybrid discrete cuckoo search algorithm; Scheduling failure factor; Cloud multi-datacenter; OPTIMIZATION APPROACH; ENERGY-CONSUMPTION; GENETIC ALGORITHM; TASK; SYSTEMS; PERFORMANCE; MAKESPAN; COST;
D O I
10.1007/s11227-022-04703-0
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Heterogeneous cloud datacenters are well-suited and cost-efficient platforms for execution of scientific workflows requested from academics. Workflow scheduling algorithms have drastic impacts on the objectives that stakeholders in the system expect. This paper models the scientific workflow scheduling issue to a bi-objective optimization problem with makespan and reliability optimization approach because the users not only expect to have quick response, but also they need reliable executions. To address the issue, a new system framework and different concepts are introduced. A centralized log as a repository module is embedded in the system framework to register all kinds of system failures. In addition to, the new scheduling failure factor (SFF), which has reciprocal relation with system reliability, is defined. Therefore, the broker module quantifies the failure proneness of all resources and the most reliable ones are incorporated in scheduling model. The aforementioned scheduling model is then formulated to a bi-objective optimization problem with makespan and SFF minimization viewpoint which is an NP-Hard problem. To solve this combinatorial problem, a hybrid bi-objective discrete cuckoo search algorithm (HDCSA) is proposed. The proposed hybrid algorithm utilizes different novel Levy flight operators commensurate with discrete search space that makes good balance between exploration and exploitation in optimization process. The proposed HDCSA was validated in 12 extensive scenarios that were conducted on both symmetric and asymmetric scientific workflows in different conditions. The final results prove that the proposed bi-objective HDCSA scheduler has the amount of 22.11%, 12.97%, 11.81%, 12.18%, and 12.42% on average improvement against other state-of-the-arts in terms of makespan, SFF, speedup, efficiency, and SLR, respectively, which are prominent performance evaluation metrics is this scheduling domain.
引用
收藏
页码:1451 / 1503
页数:53
相关论文
共 49 条
[1]   Energy-aware whale optimization algorithm for real-time task scheduling in multiprocessor systems [J].
Abdel-Basset, Mohamed ;
El-Shahat, Doaa ;
Deb, Kalyanmoy ;
Abouhawwash, Mohamed .
APPLIED SOFT COMPUTING, 2020, 93
[2]   A multi-objectives scheduling algorithm based on cuckoo optimization for task allocation problem at compile time in heterogeneous systems [J].
Akbari, Mehdi ;
Rashidi, Hassan .
EXPERT SYSTEMS WITH APPLICATIONS, 2016, 60 :234-248
[3]   Static scheduling of directed acyclic data flow graphs onto multiprocessors using particle swarm optimization [J].
Al Badawia, Ahmad ;
Shatnawi, Ali .
COMPUTERS & OPERATIONS RESEARCH, 2013, 40 (10) :2322-2328
[4]   Heuristic initialization of PSO task scheduling algorithm in cloud computing [J].
Alsaidy, Seema A. ;
Abbood, Amenah D. ;
Sahib, Mouayad A. .
JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (06) :2370-2382
[5]   List Scheduling Algorithm for Heterogeneous Systems by an Optimistic Cost Table [J].
Arabnejad, Hamid ;
Barbosa, Jorge G. .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2014, 25 (03) :682-694
[6]   Optimization procedure for algorithms of task scheduling in high performance heterogeneous distributed computing systems [J].
Bahnasawy, Nirmeen A. ;
Omara, Fatma ;
Koutb, Magdy A. ;
Mosa, Mervat .
EGYPTIAN INFORMATICS JOURNAL, 2011, 12 (03) :219-229
[7]  
Bharathi S, 2008, 2008 THIRD WORKSHOP ON WORKFLOWS IN SUPPORT OF LARGE-SCALE SCIENCE (WORKS 2008), P11
[8]   An efficient weighted bi-objective scheduling algorithm for heterogeneous systems [J].
Boeres, Cristina ;
Sardina, Idalmis Milian ;
Drummond, Lucia M. A. .
PARALLEL COMPUTING, 2011, 37 (08) :349-364
[9]   A WOA-Based Optimization Approach for Task Scheduling in Cloud Computing Systems [J].
Chen, Xuan ;
Cheng, Long ;
Liu, Cong ;
Liu, Qingzhi ;
Liu, Jinwei ;
Mao, Ying ;
Murphy, John .
IEEE SYSTEMS JOURNAL, 2020, 14 (03) :3117-3128
[10]   Task clustering-based Energy-aware Workflow Scheduling in Cloud environment [J].
Choudhary, Anita ;
Govil, Mahesh Chandra ;
Singh, Girdhari ;
Awasthi, Lalit K. ;
Pilli, E. S. .
IEEE 20TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS / IEEE 16TH INTERNATIONAL CONFERENCE ON SMART CITY / IEEE 4TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND SYSTEMS (HPCC/SMARTCITY/DSS), 2018, :968-973