Efficient Approximation Algorithms for Scheduling Coflows With Precedence Constraints in Identical Parallel Networks to Minimize Weighted Completion Time

被引:1
作者
Chen, Chi-Yeh [1 ]
机构
[1] Natl Cheng Kung Univ, Dept Comp Sci & Informat Engn, Tainan 701, Taiwan
关键词
Approximation algorithms; Optimal scheduling; Processor scheduling; Data centers; Job shop scheduling; Linear programming; Servers; coflow; datacenter network; identical parallel network; precedence constraints; scheduling algorithms;
D O I
10.1109/TSC.2023.3344481
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article focuses on the problem of coflow scheduling with precedence constraints in identical parallel networks, a well-known NP -hard problem. Coflow is a relatively new network abstraction that characterizes communication patterns in data centers. When considering workload sizes and weights that are dependent on the network topology in the input instances, the proposed algorithm for the flow-level scheduling problem achieves an approximation ratio of O(chi) where chi is the coflow number of the longest path in the directed acyclic graph (DAG). Additionally, when taking into account topology-dependent workload sizes, the algorithm achieves an approximation ratio of O(R chi) , where R represents the ratio of maximum weight to minimum weight. For the coflow-level scheduling problem, the proposed algorithm achieves an approximation ratio of O(m chi) , where m is the number of network cores when considering workload sizes and weights that are topology-dependent. Moreover, when considering topology-dependent workload sizes, the algorithm achieves an approximation ratio of O(Rm chi) . In the coflows of multi-stage job scheduling problem, the proposed algorithm achieves an approximation ratio of O(chi) . Although our theoretical results are based on a limited set of input instances, experimental findings show that the results for general input instances outperform the theoretical results.
引用
收藏
页码:2349 / 2364
页数:16
相关论文
共 30 条
[1]   Sincronia: Near-Optimal Network Design for Coflows [J].
Agarwal, Saksham ;
Rajakrishnan, Shijin ;
Narayan, Akshay ;
Agarwal, Rachit ;
Shmoys, David ;
Vahdat, Amin .
PROCEEDINGS OF THE 2018 CONFERENCE OF THE ACM SPECIAL INTEREST GROUP ON DATA COMMUNICATION (SIGCOMM '18), 2018, :16-29
[2]   On Scheduling Coflows [J].
Ahmadi, Saba ;
Khuller, Samir ;
Purohit, Manish ;
Yang, Sheng .
ALGORITHMICA, 2020, 82 (12) :3604-3629
[3]   A scalable, commodity data center network architecture [J].
Al-Fares, Mohammad ;
Loukissas, Alexander ;
Vahdat, Amin .
ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2008, 38 (04) :63-74
[4]  
[Anonymous], 2007, HADOOP PROJECT WEBSI
[5]  
[Anonymous], 2010, HotCloud
[6]  
Bansal N, 2010, LECT NOTES COMPUT SC, V6198, P250, DOI 10.1007/978-3-642-14165-2_22
[8]  
Chowdhury M, 2015, ACM SIGCOMM COMP COM, V45, P393, DOI [10.1145/2829988.2787480, 10.1145/2785956.2787480]
[9]   Efficient Coflow Scheduling with Varys [J].
Chowdhury, Mosharaf ;
Zhong, Yuan ;
Stoica, Ion .
ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2014, 44 (04) :443-454
[10]   Managing Data Transfers in Computer Clusters with Orchestra [J].
Chowdhury, Mosharaf ;
Zaharia, Matei ;
Ma, Justin ;
Jordan, Michael I. ;
Stoica, Ion .
ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2011, 41 (04) :98-109