Joint Device Selection and Bandwidth Allocation for Cost-Efficient Federated Learning in Industrial Internet of Things

被引:16
作者
Ji, Xiuzhao [1 ]
Tian, Jie [1 ]
Zhang, Haixia [2 ,3 ]
Wu, Dalei [4 ]
Li, Tiantian [1 ]
机构
[1] Shandong Normal Univ, Sch Informat Sci & Engn, Jinan 250061, Peoples R China
[2] Shandong Univ, Shandong Prov Key Lab Wireless Commun Technol, Jinan 250061, Peoples R China
[3] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[4] Univ Tennessee, Dept Comp Sci & Engn, Chattanooga, TN 37403 USA
来源
IEEE INTERNET OF THINGS JOURNAL | 2023年 / 10卷 / 10期
基金
中国国家自然科学基金;
关键词
Costs; Training; Industrial Internet of Things; Computational modeling; Optimization; Servers; Minimization; Bandwidth allocation; device selection; federated learning (FL); Industrial Internet of Things (IIoT); resource management; RESOURCE-ALLOCATION; CLIENT SELECTION; MANAGEMENT;
D O I
10.1109/JIOT.2022.3233595
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Along with the deployment of Industrial Internet of Things (IIoT), massive amounts of industrial data have been generated at the network edge, driving the evolution of edge machine learning (ML). But during the ML model training, it may bring privacy leakage by traditional central methods. To address this issue, federated learning (FL) has been proposed as a distributed learning framework for training a global model without uploading raw data to protect data privacy. Since the communication and computing resources are usually limited in IIoT networks, how to reasonably select device and allocate bandwidth is crucial for the FL model training. Therefore, this article proposes a joint edge device selection and bandwidth allocation scheme for FL to minimize the time-averaged cost under the given long-term energy budget and delay constraints in the IIoT system. To tackle with this long-term optimization problem, we construct a virtual energy deficit queue and leverage the Lyapunov optimization theory to transform it into a list of round-wise drift-plus-cost minimization problems first. Then, we design an iterative algorithm to allocate reasonable bandwidth and select appropriate devices to achieve cost minimization while satisfying the energy consumption constraints. Besides, we develop an optimality analysis of the average cost and energy violation for our proposed scheme. Extensive experiments verify that our proposed scheme can achieve superior performance in cost efficiency over other schemes while guaranteeing FL training performance.
引用
收藏
页码:9148 / 9160
页数:13
相关论文
共 41 条
  • [31] Y. LeCun, 1998, MNIST DATABASE HANDW
  • [32] Federated Learning via Over-the-Air Computation
    Yang, Kai
    Jiang, Tao
    Shi, Yuanming
    Ding, Zhi
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (03) : 2022 - 2035
  • [33] Federated Machine Learning: Concept and Applications
    Yang, Qiang
    Liu, Yang
    Chen, Tianjian
    Tong, Yongxin
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2019, 10 (02)
  • [34] Yang ZH, 2020, Arxiv, DOI [arXiv:2007.03462, 10.48550/arXiv.2007.03462, DOI 10.48550/ARXIV.2007.03462]
  • [35] Energy Efficient Federated Learning Over Wireless Communication Networks
    Yang, Zhaohui
    Chen, Mingzhe
    Saad, Walid
    Hong, Choong Seon
    Shikh-Bahaei, Mohammad
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (03) : 1935 - 1949
  • [36] Jointly Optimizing Client Selection and Resource Management in Wireless Federated Learning for Internet of Things
    Yu, Liangkun
    Albelaihi, Rana
    Sun, Xiang
    Ansari, Nirwan
    Devetsikiotis, Michael
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (06) : 4385 - 4395
  • [37] Energy-Efficient Radio Resource Allocation for Federated Edge Learning
    Zeng, Qunsong
    Du, Yuqing
    Huang, Kaibin
    Leung, Kin K.
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2020,
  • [38] Zhang Z. Y., 2019, CHINAS IND POWER RAT
  • [39] Zhao Y, 2022, Arxiv, DOI [arXiv:1806.00582, DOI 10.48550/ARXIV.1806.00582]
  • [40] CEFL: Online Admission Control, Data Scheduling, and Accuracy Tuning for Cost-Efficient Federated Learning Across Edge Nodes
    Zhou, Zhi
    Yang, Song
    Pu, Lingjun
    Yu, Shuai
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (10) : 9341 - 9356