Co-evolutionary and Elite learning-based bi-objective Poor and Rich Optimization algorithm for scheduling multiple workflows in the cloud

被引:4
作者
Li, Huifang [1 ]
Tian, Luzhi [1 ]
Xu, Guanghao [1 ]
Abreu, Julio Ruben Canizares [2 ]
Huang, Shuangxi [3 ]
Chai, Senchun [1 ]
Xia, Yuanqing [1 ]
机构
[1] Beijing Inst Technol, Sch Automat, Beijing 100081, Peoples R China
[2] Integral Automat Co CEDAI, 302 G St, Havana, Cuba
[3] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
来源
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE | 2024年 / 152卷
基金
中国国家自然科学基金;
关键词
Cloud computing; Meta-heuristics; Multi-objective optimization; Workflows; Scheduling; Poor and rich optimization algorithm; SCIENTIFIC WORKFLOWS; DEADLINE; PLAN;
D O I
10.1016/j.future.2023.10.015
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Cloud computing is a cost-effective environment for deploying large-scale scientific applications. However, multi-workflow scheduling has great challenge since users may request a series of applications with different Quality of Service (QoS) at the same time. In this paper, a Co-evolutionary and Elite learning-based bi-objective Poor and Rich Optimization algorithm (CE-PRO) is proposed for scheduling applications to minimize the makespan and cost of each workflow. First, an MPMO framework is combined with PRO to optimize two objectives by two populations, respectively for better balancing the search diversity and convergence speed, where each population is updated by an improved PRO, which adopts the middle-class sub-population and re-defines the update mechanism for rich individuals to enhance search diversity and reduce the possibility of falling into local optima. Second, to restrain each population focusing overly on its respective objective, a global information exchange pool is innovatively designed to save the non-dominated solutions ever found, which will be used back as the shared guiding solutions to foster inter-population communication and co-evolution during an evolutionary process. Third, a hybrid mutation-based Elite Enhancement Strategy (EES) is developed by introducing multiple scales of mutation operations into elite solutions alternatively and iteratively to exploit excellent individuals and explore more trade-off solutions. Extensive experiments are conducted on real world scientific workflows with different types and scales, and the experimental results demonstrate that in most cases, our proposed CE-PRO outperforms its peers in the number of obtained non-dominated solutions, and the solution diversity and quality as well. In particular, the dominance of CE-PRO is superior to its peers by at least 25.62%.
引用
收藏
页码:99 / 111
页数:13
相关论文
共 44 条
[1]   List Scheduling Algorithm for Heterogeneous Systems by an Optimistic Cost Table [J].
Arabnejad, Hamid ;
Barbosa, Jorge G. .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2014, 25 (03) :682-694
[2]   Dynamic multi-workflow scheduling: A deadline and cost-aware approach for commercial clouds [J].
Arabnejad, Vahid ;
Bubendorfer, Kris ;
Ng, Bryan .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 100 :98-108
[3]   Scheduling deadline constrained scientific workflows on dynamically provisioned cloud resources [J].
Arabnejad, Vahid ;
Bubendorfer, Kris ;
Ng, Bryan .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2017, 75 :348-364
[4]   Effectively Detecting Operational Anomalies In Large-Scale IoT Data Infrastructures By Using A GAN-Based Predictive Model [J].
Chen, Peng ;
Liu, Hongyun ;
Xin, Ruyue ;
Carval, Thierry ;
Zhao, Jiale ;
Xia, Yunni ;
Zhao, Zhiming .
COMPUTER JOURNAL, 2022, 65 (11) :2909-2925
[5]   Multiobjective Cloud Workflow Scheduling: A Multiple Populations Ant Colony System Approach [J].
Chen, Zong-Gan ;
Zhan, Zhi-Hui ;
Lin, Ying ;
Gong, Yue-Jiao ;
Gu, Tian-Long ;
Zhao, Feng ;
Yuan, Hua-Qiang ;
Chen, Xiaofeng ;
Li, Qing ;
Zhang, Jun .
IEEE TRANSACTIONS ON CYBERNETICS, 2019, 49 (08) :2912-2926
[6]  
Cheng WD, 2012, STRUCT BOND, V144, P1, DOI [10.1007/430_2011_64, 10.1109/ICADE.2012.6330087]
[7]   Handling multiple objectives with particle swarm optimization [J].
Coello, CAC ;
Pulido, GT ;
Lechuga, MS .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2004, 8 (03) :256-279
[8]   A fast and elitist multiobjective genetic algorithm: NSGA-II [J].
Deb, K ;
Pratap, A ;
Agarwal, S ;
Meyarivan, T .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2002, 6 (02) :182-197
[9]   Ant colony optimization theory: A survey [J].
Dorigo, M ;
Blum, C .
THEORETICAL COMPUTER SCIENCE, 2005, 344 (2-3) :243-278
[10]   Security-Aware Collaboration Plan Recommendation for Dynamic Multiple Workflow Processes [J].
Du, Yanhua ;
Sun, Zijian ;
Hu, Hesuan .
IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2023, 20 (01) :100-113