Acceleration and Efficiency Warranty for Distributed Machine Learning Jobs over Data Center Network with Optical Circuit Switching

被引：0
|
作者：
Wang, Cen [1 ]
Yoshikane, Noboru [1 ]
Balasis, Filippos [1 ]
Tsuritani, Takehiro [1 ]
机构：
[1] KDDI Res Inc, 2-1-15 Ohara, Fujimino, Saitama 3568502, Japan
来源：
2021 OPTICAL FIBER COMMUNICATIONS CONFERENCE AND EXPOSITION (OFC) | 2021年
关键词：
D O I：
暂无
中图分类号：
TM [电工技术]; TN [电子技术、通信技术];
学科分类号：
0808 ; 0809 ;
摘要：
Based on a DCN with OCS, we propose a pattern-aware scheduling and fast convergence strategy for the distributed machine learning jobs. Experimental results show significant accelerations for completion time and convergence of the jobs. (C) 2021 The Author(s)
引用
收藏
页数：3
相关论文
共 50 条
  • [1] Virtual Machine Migration over Optical Circuit Switching Network in a Converged Inter/Infra Data Center Architecture
    Samadi, Payman
    Xu, Junjie
    Bergman, Keren
    2015 OPTICAL FIBER COMMUNICATIONS CONFERENCE AND EXHIBITION (OFC), 2015,
  • [2] Optical Interconnection Network Based on Distributed Switching for Data Center Application
    Zhang, Yue
    Guo, Jin
    Xu, Bo
    2021 6TH INTERNATIONAL CONFERENCE ON UK-CHINA EMERGING TECHNOLOGIES (UCET 2021), 2021, : 96 - 99
  • [3] A Tale for Many: Integrated Control Mechanism of Optical Circuit Switching for Data Center and Distributed Deep Learning System
    Wang, Cen
    Wakayama, Yuta
    Yoshikane, Noboru
    Tsuritani, Takehiro
    2024 OPTICAL FIBER COMMUNICATIONS CONFERENCE AND EXHIBITION, OFC, 2024,
  • [4] COCSN: A Multi-Tiered Cascaded Optical Circuit Switching Network for Data Center
    Li, Shuo
    Gu, Huaxi
    Yu, Xiaoshan
    Huang, Hua
    Wang, Songyan
    Chang, Zeshan
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2024, 12 (04) : 1463 - 1475
  • [5] Effectively Reconfigure the Optical Circuit Switching Layer Topology in Data Center Network by OCBridge
    Tang, Yinan
    Guo, Hongxiang
    Zhu, Yong
    Yuan, Tongtong
    Gao, Xiong
    Wang, Cen
    Wu, Jian
    JOURNAL OF LIGHTWAVE TECHNOLOGY, 2019, 37 (03) : 897 - 908
  • [6] Enhancing Capacity of Optical Circuit Switching Clos Network in Data Center: Progress and Challenges
    Okil, Eiji
    Taka, Haruto
    Inoue, Takeru
    2024 33RD INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATIONS AND NETWORKS, ICCCN 2024, 2024,
  • [7] Distributed Extreme Learning Machine for Nonlinear Learning over Network
    Huang, Songyan
    Li, Chunguang
    ENTROPY, 2015, 17 (02) : 818 - 840
  • [8] Next Generation Exabit/s Data Center Network Supporting All Optical Circuit and Packet Switching
    Yan, Fulong
    Guo, Shengjie
    Bi, Yanxian
    Pan, Bitao
    Guo, Xiaotao
    Zhang, Jie
    Calabretta, Nicola
    IEEE COMMUNICATIONS MAGAZINE, 2025, 63 (02) : 136 - 142
  • [9] Optical Virtual Switching (OvS): A Distributed Optical Switching Fabric for Intra-Data Center Networking
    Zhong, Shan
    Zhu, Zhonghua
    2014 23RD WIRELESS AND OPTICAL COMMUNICATION CONFERENCE (WOCC), 2014,
  • [10] On the Latencies in a Hybrid Optical Packet Switching Network in Data Center
    Minakhmetov, Artur
    Nagarajan, Archana
    Iannone, Luigi
    Ware, Cedric
    2019 OPTICAL FIBER COMMUNICATIONS CONFERENCE AND EXHIBITION (OFC), 2019,
12345