Latency-Efficient Wireless Federated Learning With Quantization and Scheduling

被引:17
作者
Yan, Zhigang [1 ]
Li, Dong [1 ]
Yu, Xianhua [1 ]
Zhang, Zhichao [2 ,3 ]
机构
[1] Macau Univ Sci & Technol, Sch Comp Sci & Engn, Macau, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Math & Stat, Nanjing 210044, Peoples R China
[3] Macau Univ Sci & Technol, Sch Comp Sci & Engn, Macau, Peoples R China
关键词
Quantization (signal); Upper bound; Training; Optimal scheduling; Bandwidth; Resource management; Mathematical models; Federated learning; quantization; scheduling; channel and power allocation; convergence analysis; RESOURCE-ALLOCATION;
D O I
10.1109/LCOMM.2022.3199490
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Federated learning (FL) protects data privacy through local training and parameter aggregation. However, there is no need that all users are required to train their local models, and the parameter needs to be quantized via wireless channels in practice. In this letter, we investigate and analyze how to improve the model prediction accuracy with the system latency guarantee. Specifically, our goal is to minimize the loss function under the latency constraint by taking the parameter quantization, user scheduling, and channel bandwidth and transmit power into account. To make the optimization problem tractable, we first derive an upper bound on the loss function with joint quantization and scheduling and an upper bound on the number of bits for parameter aggregation, and then solve the reformulated problem based on the derived upper bounds to obtain closed-form expressions for the quantization level, the scheduling number, the optimized bandwidth and power allocation. Simulation results confirm the convergence and the effectiveness of the proposed algorithm.
引用
收藏
页码:2621 / 2625
页数:5
相关论文
共 19 条
[1]  
Alistarh D, 2017, ADV NEUR IN, V30
[2]   Robust Federated Learning With Noisy Communication [J].
Ang, Fan ;
Chen, Li ;
Zhao, Nan ;
Chen, Yunfei ;
Wang, Weidong ;
Yu, F. Richard .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (06) :3452-3464
[3]   Federated Learning Over Energy Harvesting Wireless Networks [J].
Hamdi, Rami ;
Chen, Mingzhe ;
Ben Said, Ahmed ;
Qaraqe, Marwa ;
Poor, H. Vincent .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (01) :92-103
[4]   Device Scheduling and Update Aggregation Policies for Asynchronous Federated Learning [J].
Hu, Chung-Hsuan ;
Chen, Zheng ;
Larsson, Erik G. .
2021 IEEE 22ND INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (SPAWC), 2021, :281-285
[5]   Adaptive Transmission Scheduling in Wireless Networks for Asynchronous Federated Learning [J].
Lee, Hyun-Suk ;
Lee, Jang-Won .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (12) :3673-3687
[6]   Joint Optimal Quantization and Aggregation of Federated Learning Scheme in VANETs [J].
Li, Yifei ;
Guo, Yijia ;
Alazab, Mamoun ;
Chen, Shengbo ;
Shen, Cong ;
Yu, Keping .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) :19852-19863
[7]   Rethinking Sustainable Sensing in Agricultural Internet of Things: From Power Supply Perspective [J].
Liu, Ye ;
Li, Dong ;
Du, Bangsong ;
Shu, Lei ;
Han, Guangjie .
IEEE WIRELESS COMMUNICATIONS, 2022, 29 (04) :102-109
[8]   Cost-Effective Federated Learning in Mobile Edge Networks [J].
Luo, Bing ;
Li, Xiang ;
Wang, Shiqiang ;
Huang, Jianwei ;
Tassiulas, Leandros .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (12) :3606-3621
[9]  
McMahan HB, 2017, PR MACH LEARN RES, V54, P1273
[10]  
Mohammad U.F., 2021, 2021 IEEE 18th Annual Consumer Communications Networking Conference (CCNC), P1