Client Scheduling and Resource Management for Efficient Training in Heterogeneous IoT-Edge Federated Learning

被引:45
作者
Cui, Yangguan [1 ]
Cao, Kun [2 ]
Cao, Guitao [3 ]
Qiu, Meikang [4 ]
Wei, Tongquan [1 ]
机构
[1] East China Normal Univ, Sch Comp Sci & Technol, Shanghai Key Lab Trustworthy Comp, Shanghai 200062, Peoples R China
[2] Jinan Univ, Coll Informat Sci & Technol, Guangzhou 510632, Peoples R China
[3] East China Normal Univ, Software Engn Inst, Shanghai 200062, Peoples R China
[4] Texas A&M Univ, Dept Comp Sci & Informat Syst, Commerce, TX 75428 USA
基金
中国博士后科学基金;
关键词
Client scheduling; efficient training; hetero-geneity; Internet of Things (IoT)-edge federated learning (FL); resource block allocation; OPTIMIZATION; ALLOCATION; COMMUNICATION; CONVERGENCE;
D O I
10.1109/TCAD.2021.3110743
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning (FL) offers a promising paradigm that empowers numerous Internet of Things (IoT) devices to implement distributed learning on the premise of ensuring user privacy and data security. However, since FL adopts a synchronous distributed training mode, the heterogeneity of participating IoT devices and limited communication resources make FL encounter serious issues of low training efficiency in actual deployment. In this article, we propose an excellent FL policy for the heterogeneous IoT-edge FL system to improve distributed training efficiency. Specifically, first, by borrowing the idea of clustering, we explore an iterative self-organizing data analysis techniques algorithm (ISODATA)-based heterogeneous-aware client scheduling strategy to alleviate the issue of low training efficiency incurred by the heterogeneity of clients. Subsequently, to tackle the challenge of limited communication resources in FL, we first analyze the characteristics of the optimal resource block allocation solution theoretically and then introduce a mixed-integer linear programming (MILP)-based strategy to judiciously allocate resource blocks for scheduled clients. Comprehensive experimental results demonstrate that, compared with benchmarking strategies, our proposed FL policy can achieve up to 55.22% accuracy improvement in a relaxed time scenario, and attain up to 3.62 x acceleration for reaching the specific expected accuracy.
引用
收藏
页码:2407 / 2420
页数:14
相关论文
共 41 条
  • [1] Wireless Federated Distillation for Distributed Edge Learning with Heterogeneous Data
    Ahn, Jin-Hyun
    Simeone, Osvaldo
    Kang, Joonhyuk
    [J]. 2019 IEEE 30TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2019, : 1138 - 1143
  • [2] Robust Deep Reservoir Computing Through Reliable Memristor With Improved Heat Dissipation Capability
    An, Hongyu
    Al-Mamun, Mohammad Shah
    Orlowski, Marius K.
    Liu, Lingjia
    Yi, Yang
    [J]. IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2021, 40 (03) : 574 - 583
  • [4] Caldas S, 2019, Arxiv, DOI arXiv:1812.07210
  • [5] Edge Intelligent Joint Optimization for Lifetime and Latency in Large-Scale Cyber-Physical Systems
    Cao, Kun
    Cui, Yangguang
    Liu, Zhiquan
    Tan, Wuzheng
    Weng, Jian
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (22): : 22267 - 22279
  • [6] A Survey on Edge and Edge-Cloud Computing Assisted Cyber-Physical Systems
    Cao, Kun
    Hu, Shiyan
    Shi, Yang
    Colombo, Armando
    Karnouskos, Stamatis
    Li, Xin
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (11) : 7806 - 7819
  • [7] Exploring Renewable-Adaptive Computation Offloading for Hierarchical QoS Optimization in Fog Computing
    Cao, Kun
    Zhou, Junlong
    Xu, Guo
    Wei, Tongquan
    Hu, Shiyan
    [J]. IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2020, 39 (10) : 2095 - 2108
  • [8] Communication-efficient federated learning
    Chen, Mingzhe
    Shlezinger, Nir
    Poor, H. Vincent
    Eldar, Yonina C.
    Cui, Shuguang
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2021, 118 (17)
  • [9] Convergence Time Minimization of Federated Learning over Wireless Networks
    Chen, Mingzhe
    Poor, H. Vincent
    Saad, Walid
    Cui, Shuguang
    [J]. ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [10] A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
    Chen, Mingzhe
    Yang, Zhaohui
    Saad, Walid
    Yin, Changchuan
    Poor, H. Vincent
    Cui, Shuguang
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) : 269 - 283