Efficient Approximation Algorithms for Scheduling Coflows With Precedence Constraints in Identical Parallel Networks to Minimize Weighted Completion Time

被引:1
作者
Chen, Chi-Yeh [1 ]
机构
[1] Natl Cheng Kung Univ, Dept Comp Sci & Informat Engn, Tainan 701, Taiwan
关键词
Approximation algorithms; Optimal scheduling; Processor scheduling; Data centers; Job shop scheduling; Linear programming; Servers; coflow; datacenter network; identical parallel network; precedence constraints; scheduling algorithms;
D O I
10.1109/TSC.2023.3344481
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article focuses on the problem of coflow scheduling with precedence constraints in identical parallel networks, a well-known NP -hard problem. Coflow is a relatively new network abstraction that characterizes communication patterns in data centers. When considering workload sizes and weights that are dependent on the network topology in the input instances, the proposed algorithm for the flow-level scheduling problem achieves an approximation ratio of O(chi) where chi is the coflow number of the longest path in the directed acyclic graph (DAG). Additionally, when taking into account topology-dependent workload sizes, the algorithm achieves an approximation ratio of O(R chi) , where R represents the ratio of maximum weight to minimum weight. For the coflow-level scheduling problem, the proposed algorithm achieves an approximation ratio of O(m chi) , where m is the number of network cores when considering workload sizes and weights that are topology-dependent. Moreover, when considering topology-dependent workload sizes, the algorithm achieves an approximation ratio of O(Rm chi) . In the coflows of multi-stage job scheduling problem, the proposed algorithm achieves an approximation ratio of O(chi) . Although our theoretical results are based on a limited set of input instances, experimental findings show that the results for general input instances outperform the theoretical results.
引用
收藏
页码:2349 / 2364
页数:16
相关论文
共 30 条
  • [1] Sincronia: Near-Optimal Network Design for Coflows
    Agarwal, Saksham
    Rajakrishnan, Shijin
    Narayan, Akshay
    Agarwal, Rachit
    Shmoys, David
    Vahdat, Amin
    [J]. PROCEEDINGS OF THE 2018 CONFERENCE OF THE ACM SPECIAL INTEREST GROUP ON DATA COMMUNICATION (SIGCOMM '18), 2018, : 16 - 29
  • [2] On Scheduling Coflows
    Ahmadi, Saba
    Khuller, Samir
    Purohit, Manish
    Yang, Sheng
    [J]. ALGORITHMICA, 2020, 82 (12) : 3604 - 3629
  • [3] A scalable, commodity data center network architecture
    Al-Fares, Mohammad
    Loukissas, Alexander
    Vahdat, Amin
    [J]. ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2008, 38 (04) : 63 - 74
  • [4] [Anonymous], 2010, 2 USENIX WORKSH HOT
  • [5] Bansal N, 2010, LECT NOTES COMPUT SC, V6198, P250, DOI 10.1007/978-3-642-14165-2_22
  • [6] Borthakur D., 2007, The Hadoop Distributed File System: Architecture and Design, V11, P21
  • [8] Chowdhury M, 2015, ACM SIGCOMM COMP COM, V45, P393, DOI [10.1145/2829988.2787480, 10.1145/2785956.2787480]
  • [9] Efficient Coflow Scheduling with Varys
    Chowdhury, Mosharaf
    Zhong, Yuan
    Stoica, Ion
    [J]. ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2014, 44 (04) : 443 - 454
  • [10] Managing Data Transfers in Computer Clusters with Orchestra
    Chowdhury, Mosharaf
    Zaharia, Matei
    Ma, Justin
    Jordan, Michael I.
    Stoica, Ion
    [J]. ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2011, 41 (04) : 98 - 109