A Two-stage Multi-population Genetic Algorithm with Heuristics for Workflow Scheduling in Heterogeneous Distributed Computing Environments

被引:40
作者
Xie, Yi [1 ,2 ]
Gui, Feng-Xian [1 ]
Wang, Wei-Jun [1 ]
Chien, Chen-Fu [3 ]
机构
[1] Zhejiang Gongshang Univ, Sch Management Engn & E Business, Hangzhou 310018, Zhejiang, Peoples R China
[2] Zhejiang Gongshang Univ, Contemporary Business & Trade Res Ctr, Hangzhou 310018, Zhejiang, Peoples R China
[3] Natl Tsing Hua Univ, Dept Ind Engn & Engn Management, Hsinchu 30013, Taiwan
关键词
Workflow; scheduling; genetic algorithm; makespan; digital transformation; SCIENTIFIC WORKFLOWS; CLOUD; OPTIMIZATION; SCHEME;
D O I
10.1109/TCC.2021.3137881
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Workflow scheduling in Heterogeneous Distributed Computing Environments (HDCEs) is a NP-hard problem. Although a number of scheduling approaches have been proposed for workflow scheduling in HDCEs, there is still a room and need for improvement. To fill the gaps, this study formulates workflow scheduling problem in HDCEs as a complete, solvable and extensible integer programming mathematical model with precedence and resource constraints that provides a theoretical foundation for developing workflow scheduling strategy. Then, this study develops a novel two-stage multi-population genetic algorithm with heuristics for workflow scheduling. In particular, two-stage multi-population coevolution strategy is employed with designed novel methods for population initialization, genetic operation, individual decoding and improvement. To estimate the validity, extensive experiments are designed and conducted on various scenarios based on real and random workflow applications. The results have shown the practical viability of the proposed algorithm outperforming conventional approaches.
引用
收藏
页码:1446 / 1460
页数:15
相关论文
共 56 条
[1]   Cost-Driven Scheduling of Grid Workflows Using Partial Critical Paths [J].
Abrishami, Saeid ;
Naghibzadeh, Mahmoud ;
Epema, Dick H. J. .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2012, 23 (08) :1400-1414
[2]   A Survey on Scheduling Strategies for Workflows in Cloud Environment and Emerging Trends [J].
Adhikari, Mainak ;
Amgoth, Tarachand ;
Srirama, Satish Narayana .
ACM COMPUTING SURVEYS, 2019, 52 (04)
[3]   Design of an efficient genetic algorithm for resource-constrained unrelated parallel machine scheduling problem with machine eligibility restrictions [J].
Afzalirad, Mojtaba ;
Shafipour, Masoud .
JOURNAL OF INTELLIGENT MANUFACTURING, 2018, 29 (02) :423-437
[4]   A hybrid genetic algorithm for optimization of scheduling workflow applications in heterogeneous computing systems [J].
Ahmad, Saima Gulzar ;
Liew, Chee Sun ;
Munir, Ehsan Ullah ;
Fong, Ang Tan ;
Khan, Samee U. .
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2016, 87 :80-90
[5]   Tri-Objective Workflow Scheduling and Optimization in Heterogeneous Cloud Environments [J].
Alrammah, Huda ;
Gu, Yi ;
Liu, Zhifeng .
2020 IEEE 34TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW 2020), 2020, :739-748
[6]   An efficient cost-based algorithm for scheduling workflow tasks in cloud computing systems [J].
Amoon, Mohammed ;
El-Bahnasawy, Nirmeen ;
ElKazaz, Mai .
NEURAL COMPUTING & APPLICATIONS, 2019, 31 (05) :1353-1363
[7]   Budget and Deadline Aware e-Science Workflow Scheduling in Clouds [J].
Arabnejad, Vahid ;
Bubendorfer, Kris ;
Ng, Bryan .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2019, 30 (01) :29-44
[8]   Genetic Algorithm and Its Applications to Mechanical Engineering: A Review [J].
Bhoskar, Trupti ;
Kulkarni, Omkar K. ;
Kulkarni, Ninad K. ;
Patekar, Sujata L. ;
Kakandikar, G. M. ;
Nandedkar, V. M. .
MATERIALS TODAY-PROCEEDINGS, 2015, 2 (4-5) :2624-2630
[9]   Efficient Scheduling Mapping Algorithm for Row Parallel Coarse-Grained Reconfigurable Architecture [J].
Chen, Naijin ;
Wang, Zhen ;
He, Ruixiang ;
Jiang, Jianhui ;
Cheng, Fei ;
Han, Chenghao .
TSINGHUA SCIENCE AND TECHNOLOGY, 2021, 26 (05) :724-735
[10]   Multiobjective Cloud Workflow Scheduling: A Multiple Populations Ant Colony System Approach [J].
Chen, Zong-Gan ;
Zhan, Zhi-Hui ;
Lin, Ying ;
Gong, Yue-Jiao ;
Gu, Tian-Long ;
Zhao, Feng ;
Yuan, Hua-Qiang ;
Chen, Xiaofeng ;
Li, Qing ;
Zhang, Jun .
IEEE TRANSACTIONS ON CYBERNETICS, 2019, 49 (08) :2912-2926