Scheduling coflows for minimizing the total weighted completion time in heterogeneous parallel networks

被引:2
作者
Chen, Chi-Yeh [1 ]
机构
[1] Natl Cheng Kung Univ, Dept Comp Sci & Informat Engn, 1 Univ Rd, Tainan 701401, Taiwan
关键词
Scheduling algorithms; Approximation algorithms; Coflow; Datacenter network; Heterogeneous parallel network;
D O I
10.1016/j.jpdc.2023.104752
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Coflow is a network abstraction used to represent communication patterns in data centers. The coflow scheduling problem encountered in large data centers is a challenging NP-hard problem. Many previous studies on coflow scheduling mainly focus on the single-core model. However, with the growth of data centers, this single-core model is no longer sufficient. This paper addresses the coflow scheduling problem within heterogeneous parallel networks, which feature an architecture consisting of multiple network cores running in parallel. In this paper, two polynomial-time approximation algorithms are developed for the flow-level scheduling problem and the coflow-level scheduling problem in heterogeneous parallel networks, respectively. For the flow-level scheduling problem, the proposed algorithm achieves an approximation ratio of O (log m/ log log m) when all coflows are released at arbitrary times, where m represents the number of network cores. On the other hand, in the coflow-level scheduling problem, the proposed algorithm achieves an approximation ratio of O (m(log m/ log log m)(2)) when all coflows are released at arbitrary times. Moreover, we propose a heuristic algorithm for the flow-level scheduling problem. Simulation results using synthetic traffic traces validate the performance of our algorithms and show improvements over the previous algorithm. (c) 2023 The Author(s). Published by Elsevier Inc. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org /licenses/by-nc-nd /4 .0/).
引用
收藏
页数:12
相关论文
共 37 条
  • [1] Sincronia: Near-Optimal Network Design for Coflows
    Agarwal, Saksham
    Rajakrishnan, Shijin
    Narayan, Akshay
    Agarwal, Rachit
    Shmoys, David
    Vahdat, Amin
    [J]. PROCEEDINGS OF THE 2018 CONFERENCE OF THE ACM SPECIAL INTEREST GROUP ON DATA COMMUNICATION (SIGCOMM '18), 2018, : 16 - 29
  • [2] On Scheduling Coflows
    Ahmadi, Saba
    Khuller, Samir
    Purohit, Manish
    Yang, Sheng
    [J]. ALGORITHMICA, 2020, 82 (12) : 3604 - 3629
  • [3] A scalable, commodity data center network architecture
    Al-Fares, Mohammad
    Loukissas, Alexander
    Vahdat, Amin
    [J]. ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2008, 38 (04) : 63 - 74
  • [4] Bansal N, 2010, LECT NOTES COMPUT SC, V6198, P250, DOI 10.1007/978-3-642-14165-2_22
  • [5] Borthakur D., 2007, HADOOP DISTRIBUTED F, V11, P21
  • [6] Supply chain scheduling: Conflict and cooperation in assembly systems
    Chen, Zhi-Long
    Hall, Nicholas G.
    [J]. OPERATIONS RESEARCH, 2007, 55 (06) : 1072 - 1089
  • [7] Chowdhury M., Coflowsim
  • [8] Chowdhury M, 2015, ACM SIGCOMM COMP COM, V45, P393, DOI [10.1145/2829988.2787480, 10.1145/2785956.2787480]
  • [9] Efficient Coflow Scheduling with Varys
    Chowdhury, Mosharaf
    Zhong, Yuan
    Stoica, Ion
    [J]. ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2014, 44 (04) : 443 - 454
  • [10] Managing Data Transfers in Computer Clusters with Orchestra
    Chowdhury, Mosharaf
    Zaharia, Matei
    Ma, Justin
    Jordan, Michael I.
    Stoica, Ion
    [J]. ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2011, 41 (04) : 98 - 109