Clustering-Based Task Scheduling in a Large Number of Heterogeneous Processors

被引:68
作者
Kanemitsu, Hidehiro [1 ]
Hanada, Masaki [2 ]
Nakazato, Hidenori [3 ]
机构
[1] Waseda Univ, Global Educ Ctr, Shinjuku Ku, 1-6-1 Nishiwaseda, Tokyo 1698050, Japan
[2] Tokyo Univ Informat Sci, Dept Informat Syst, Wakaba Ku, 4-1 Onaridai, Chiba 2658501, Japan
[3] Waseda Univ, Dept Commun & Comp Engn, Shinjuku Ku, 3-14-9 Ohkubo, Tokyo 1690072, Japan
关键词
Task scheduling; DAG scheduling; task clustering; heterogeneous systems; COMPUTING SYSTEMS; GRAPHS; AWARE; MULTIPROCESSORS; ALGORITHMS; CLOUDS;
D O I
10.1109/TPDS.2016.2526682
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Parallelization paradigms for effective execution in a Directed Acyclic Graph (DAG) application have been widely studied in the area of task scheduling. Schedule length can be varied depending on task assignment policies, scheduling policies, and heterogeneity in terms of each processor and each communication bandwidth in a heterogeneous system. One disadvantage of existing task scheduling algorithms is that the schedule length cannot be reduced for a data intensive application. In this paper, we propose a clustering-based task scheduling algorithm called Clustering for Minimizing the Worst Schedule Length (CMWSL) to minimize the schedule length in a large number of heterogeneous processors. First, the proposed method derives the lower bound of the total execution time for each processor by taking both the system and application characteristics into account. As a result, the number of processors used for actual execution is regulated to minimize the Worst Schedule Length (WSL). Then, the actual task assignment and task clustering are performed to minimize the schedule length until the total execution time in a task cluster exceeds the lower bound. Experimental results indicate that CMWSL outperforms both existing list-based and clustering-based task scheduling algorithms in terms of the schedule length and efficiency, especially in data-intensive applications.
引用
收藏
页码:3144 / 3157
页数:14
相关论文
共 36 条
[1]   Scheduling algorithms for parallel Gaussian elimination with communication costs [J].
Amoura, AK ;
Bampis, E ;
Konig, JC .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 1998, 9 (07) :679-686
[2]  
[Anonymous], 1989, Partitioning and Scheduling Parallel Programs for Multiprocessors
[3]  
[Anonymous], 1976, COMPUTER JOB SCHEDUL
[4]  
[Anonymous], GRID COMPUT
[5]   List Scheduling Algorithm for Heterogeneous Systems by an Optimistic Cost Table [J].
Arabnejad, Hamid ;
Barbosa, Jorge G. .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2014, 25 (03) :682-694
[6]   A cluster-based strategy for scheduling task on heterogeneous processors [J].
Boeres, C ;
Viterbo, J ;
Rebello, VEF .
16TH SYMPOSIUM ON COMPUTER ARCHITECTURE AND HIGH PERFORMANCE COMPUTING, PROCEEDINGS, 2004, :214-221
[7]  
BOERES C, 2001, P 15 INT PAR DISTR P
[8]   A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems [J].
Braun, TD ;
Siegel, HJ ;
Beck, N ;
Bölöni, LL ;
Maheswaran, M ;
Reuther, AI ;
Robertson, JP ;
Theys, MD ;
Yao, B ;
Hensgen, D ;
Freund, RF .
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2001, 61 (06) :810-837
[9]  
Chabridon S., 1995, Proceedings Euromicro Workshop on Parallel and Distributed Processing, P350, DOI 10.1109/EMPDP.1995.389188
[10]   A flexible clustering and scheduling scheme for efficient parallel computation [J].
Chingchit, S ;
Kumar, M ;
Bhuyan, LN .
IPPS/SPDP 1999: 13TH INTERNATIONAL PARALLEL PROCESSING SYMPOSIUM & 10TH SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING, PROCEEDINGS, 1999, :500-505