Latency-Efficient Wireless Federated Learning With Quantization and Scheduling

被引:14
作者
Yan, Zhigang [1 ]
Li, Dong [1 ]
Yu, Xianhua [1 ]
Zhang, Zhichao [2 ,3 ]
机构
[1] Macau Univ Sci & Technol, Sch Comp Sci & Engn, Macau, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Math & Stat, Nanjing 210044, Peoples R China
[3] Macau Univ Sci & Technol, Sch Comp Sci & Engn, Macau, Peoples R China
关键词
Quantization (signal); Upper bound; Training; Optimal scheduling; Bandwidth; Resource management; Mathematical models; Federated learning; quantization; scheduling; channel and power allocation; convergence analysis; RESOURCE-ALLOCATION;
D O I
10.1109/LCOMM.2022.3199490
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Federated learning (FL) protects data privacy through local training and parameter aggregation. However, there is no need that all users are required to train their local models, and the parameter needs to be quantized via wireless channels in practice. In this letter, we investigate and analyze how to improve the model prediction accuracy with the system latency guarantee. Specifically, our goal is to minimize the loss function under the latency constraint by taking the parameter quantization, user scheduling, and channel bandwidth and transmit power into account. To make the optimization problem tractable, we first derive an upper bound on the loss function with joint quantization and scheduling and an upper bound on the number of bits for parameter aggregation, and then solve the reformulated problem based on the derived upper bounds to obtain closed-form expressions for the quantization level, the scheduling number, the optimized bandwidth and power allocation. Simulation results confirm the convergence and the effectiveness of the proposed algorithm.
引用
收藏
页码:2621 / 2625
页数:5
相关论文
共 19 条
  • [1] Alistarh D, 2017, ADV NEUR IN, V30
  • [2] Robust Federated Learning With Noisy Communication
    Ang, Fan
    Chen, Li
    Zhao, Nan
    Chen, Yunfei
    Wang, Weidong
    Yu, F. Richard
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (06) : 3452 - 3464
  • [3] Federated Learning Over Energy Harvesting Wireless Networks
    Hamdi, Rami
    Chen, Mingzhe
    Ben Said, Ahmed
    Qaraqe, Marwa
    Poor, H. Vincent
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (01) : 92 - 103
  • [4] Device Scheduling and Update Aggregation Policies for Asynchronous Federated Learning
    Hu, Chung-Hsuan
    Chen, Zheng
    Larsson, Erik G.
    [J]. SPAWC 2021: 2021 IEEE 22ND INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (IEEE SPAWC 2021), 2020, : 281 - 285
  • [5] Adaptive Transmission Scheduling in Wireless Networks for Asynchronous Federated Learning
    Lee, Hyun-Suk
    Lee, Jang-Won
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (12) : 3673 - 3687
  • [6] Joint Optimal Quantization and Aggregation of Federated Learning Scheme in VANETs
    Li, Yifei
    Guo, Yijia
    Alazab, Mamoun
    Chen, Shengbo
    Shen, Cong
    Yu, Keping
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) : 19852 - 19863
  • [7] Rethinking Sustainable Sensing in Agricultural Internet of Things: From Power Supply Perspective
    Liu, Ye
    Li, Dong
    Du, Bangsong
    Shu, Lei
    Han, Guangjie
    [J]. IEEE WIRELESS COMMUNICATIONS, 2022, 29 (04) : 102 - 109
  • [8] Cost-Effective Federated Learning in Mobile Edge Networks
    Luo, Bing
    Li, Xiang
    Wang, Shiqiang
    Huang, Jianwei
    Tassiulas, Leandros
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (12) : 3606 - 3621
  • [9] McMahan HB, 2017, PR MACH LEARN RES, V54, P1273
  • [10] Mohammad U.F., 2021, 2021 IEEE 18th Annual Consumer Communications Networking Conference (CCNC), P1