Joint Device Selection and Bandwidth Allocation for Cost-Efficient Federated Learning in Industrial Internet of Things

被引:16
作者
Ji, Xiuzhao [1 ]
Tian, Jie [1 ]
Zhang, Haixia [2 ,3 ]
Wu, Dalei [4 ]
Li, Tiantian [1 ]
机构
[1] Shandong Normal Univ, Sch Informat Sci & Engn, Jinan 250061, Peoples R China
[2] Shandong Univ, Shandong Prov Key Lab Wireless Commun Technol, Jinan 250061, Peoples R China
[3] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[4] Univ Tennessee, Dept Comp Sci & Engn, Chattanooga, TN 37403 USA
来源
IEEE INTERNET OF THINGS JOURNAL | 2023年 / 10卷 / 10期
基金
中国国家自然科学基金;
关键词
Costs; Training; Industrial Internet of Things; Computational modeling; Optimization; Servers; Minimization; Bandwidth allocation; device selection; federated learning (FL); Industrial Internet of Things (IIoT); resource management; RESOURCE-ALLOCATION; CLIENT SELECTION; MANAGEMENT;
D O I
10.1109/JIOT.2022.3233595
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Along with the deployment of Industrial Internet of Things (IIoT), massive amounts of industrial data have been generated at the network edge, driving the evolution of edge machine learning (ML). But during the ML model training, it may bring privacy leakage by traditional central methods. To address this issue, federated learning (FL) has been proposed as a distributed learning framework for training a global model without uploading raw data to protect data privacy. Since the communication and computing resources are usually limited in IIoT networks, how to reasonably select device and allocate bandwidth is crucial for the FL model training. Therefore, this article proposes a joint edge device selection and bandwidth allocation scheme for FL to minimize the time-averaged cost under the given long-term energy budget and delay constraints in the IIoT system. To tackle with this long-term optimization problem, we construct a virtual energy deficit queue and leverage the Lyapunov optimization theory to transform it into a list of round-wise drift-plus-cost minimization problems first. Then, we design an iterative algorithm to allocate reasonable bandwidth and select appropriate devices to achieve cost minimization while satisfying the energy consumption constraints. Besides, we develop an optimality analysis of the average cost and energy violation for our proposed scheme. Extensive experiments verify that our proposed scheme can achieve superior performance in cost efficiency over other schemes while guaranteeing FL training performance.
引用
收藏
页码:9148 / 9160
页数:13
相关论文
共 41 条
  • [1] [Anonymous], 2022, Azure bandwidth pricing
  • [2] Boyd S., 2004, CONVEX OPTIMIZATION, DOI [DOI 10.1017/CBO9780511804441, 10.1017/CBO9780511804441]
  • [3] Convergence Time Optimization for Federated Learning Over Wireless Networks
    Chen, Mingzhe
    Poor, H. Vincent
    Saad, Walid
    Cui, Shuguang
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (04) : 2457 - 2471
  • [4] A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
    Chen, Mingzhe
    Yang, Zhaohui
    Saad, Walid
    Yin, Changchuan
    Poor, H. Vincent
    Cui, Shuguang
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) : 269 - 283
  • [5] Dynamic Aggregation for Heterogeneous Quantization in Federated Learning
    Chen, Shengbo
    Shen, Cong
    Zhang, Lanxue
    Tang, Yuanmin
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (10) : 6804 - 6819
  • [6] Resource Allocation for Latency-Aware Federated Learning in Industrial Internet of Things
    Gao, Weifeng
    Zhao, Zhiwei
    Min, Geyong
    Ni, Qiang
    Jiang, Yuhong
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (12) : 8505 - 8513
  • [7] Towards Secure Industrial IoT: Blockchain System With Credit-Based Consensus Mechanism
    Huang, Junqin
    Kong, Linghe
    Chen, Guihai
    Wu, Min-You
    Liu, Xue
    Zeng, Peng
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2019, 15 (06) : 3680 - 3689
  • [8] The Duo of Artificial Intelligence and Big Data for Industry 4.0: Applications, Techniques, Challenges, and Future Research Directions
    Jagatheesaperumal, Senthil Kumar
    Rahouti, Mohamed
    Ahmad, Kashif
    Al-Fuqaha, Ala
    Guizani, Mohsen
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (15) : 12861 - 12885
  • [9] Joint Client Selection and Bandwidth Allocation Algorithm for Federated Learning
    Ko, Haneul
    Lee, Jaewook
    Seo, Sangwon
    Pack, Sangheon
    Leung, Victor C. M.
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (06) : 3380 - 3390
  • [10] Konecny J., 2016, ARXIV161005492, P1, DOI DOI 10.1109/ICDCS.2019.00080