Towards decomposition based multi-objective workflow scheduling for big data processing in clouds

被引:12
作者
Bugingo, Emmanuel [1 ]
Zhang, Defu [1 ]
Chen, Zhaobin [1 ]
Zheng, Wei [1 ]
机构
[1] Xiamen Univ, Sch Informat, Dept Comp Sci, Xiamen, Peoples R China
来源
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS | 2021年 / 24卷 / 01期
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Multi-objective optimization; Workflow scheduling; Cloud computing; Decomposition approach; ALGORITHM; DEADLINE; COST;
D O I
10.1007/s10586-020-03208-w
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A workflow is a group of tasks that are processed in a particular order to complete an application. Also, it is a popular paradigm used to model complex big-data applications. Executing complex applications in a distributed system such as cloud or cluster implicates optimization of several conflicting objectives such as monetary cost, energy consumption, total execution time of the application (makespan). Regardless of this trend, most of the workflow scheduling approaches focused on single or bi-objective optimization problem. In this paper, we considered the problem of scheduling workflows in a cloud environment as a multi-objective optimization problem, and hence proposed a multi-objective workflow-scheduling algorithm based on decomposition. The proposed algorithm is capable of finding optimal solutions with a single run. Our evaluation results show that, by a single run, the proposed approach manages to obtain the Pareto Front solutions which are at least as good as schedules produced by running a single-objective scheduling algorithm with constraints for multiple times.
引用
收藏
页码:115 / 139
页数:25
相关论文
共 31 条
[1]   MOWS: Multi-objective workflow scheduling in cloud computing based on heuristic algorithm [J].
Abazari, Farzaneh ;
Analoui, Morteza ;
Takabi, Hassan ;
Fu, Song .
SIMULATION MODELLING PRACTICE AND THEORY, 2019, 93 :119-132
[2]   A dynamic VM provisioning and de-provisioning based cost-efficient deadline-aware scheduling algorithm for Big Data workflow applications in a cloud environment [J].
Ahmad, Wakar ;
Alam, Bashir ;
Ahuja, Sanchit ;
Malik, Sahil .
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2021, 24 (01) :249-278
[3]  
[Anonymous], 2008, ELASTICSHOSTS ELASTI
[4]  
[Anonymous], 2009, CLOUDSIGMA CLOUDSIGM
[5]   A novel task scheduling approach based on dynamic queues and hybrid meta-heuristic algorithms for cloud computing environment [J].
Ben Alla, Hicham ;
Ben Alla, Said ;
Touhafi, Abdellah ;
Ezzati, Abdellah .
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2018, 21 (04) :1797-1820
[6]   Decomposition Based Multi-objective Workflow Scheduling for Cloud Environments [J].
Bugingo, Emmanuel ;
Zheng, Wei ;
Zhang, Dongzhan ;
Qin, Yingsheng ;
Zhang, Defu .
2019 SEVENTH INTERNATIONAL CONFERENCE ON ADVANCED CLOUD AND BIG DATA (CBD), 2019, :37-42
[7]   A GSA based hybrid algorithm for bi-objective workflow scheduling in cloud computing [J].
Choudhary, Anubhav ;
Gupta, Indrajeet ;
Singh, Vishakha ;
Jana, Prasanta K. .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 83 :14-26
[8]   Cost optimization heuristics for deadline constrained workflow scheduling on clouds and their comparative evaluation [J].
Emmanuel, Bugingo ;
Qin, Yingsheng ;
Wang, Juntao ;
Zhang, Defu ;
Zheng, Wei .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2018, 30 (20)
[9]  
Garey M. R., 1979, Computers and intractability. A guide to the theory of NP-completeness
[10]   Multi-Objective Task and Workflow Scheduling Approaches in Cloud Computing: a Comprehensive Review [J].
Hosseinzadeh, Mehdi ;
Ghafour, Marwan Yassin ;
Hama, Hawkar Kamaran ;
Vo, Bay ;
Khoshnevis, Afsane .
JOURNAL OF GRID COMPUTING, 2020, 18 (03) :327-356