Robust Federated Learning in Wireless Channels with Transmission Outage and Quantization Errors

被引:4
作者
Wang, Yanmeng [1 ,2 ]
Xu, Yanqing [1 ,2 ]
Shi, Qingjiang [2 ,3 ]
Chang, Tsung-Hui [1 ,2 ]
机构
[1] Chinese Univ Hong Kong, Sch Sci & Engn, Shenzhen 518172, Peoples R China
[2] Shenzhen Res Inst Big Data, Shenzhen 518172, Peoples R China
[3] Tongji Univ, Sch Software Engn, Shanghai 201804, Peoples R China
来源
2021 IEEE 22ND INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (SPAWC) | 2021年
关键词
Federated learning; transmission outage; quantization error; wireless resource allocation; COMMUNICATION;
D O I
10.1109/SPAWC51858.2021.9593221
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Federated learning (FL) has been recognized as a viable distributed learning paradigm which trains a machine learning model collaboratively with massive mobile devices in the wireless edge while protecting user privacy. Although various communication schemes have been proposed to reduce the training latency in order to expedite the FL learning process, most of them have assumed that the wireless channels are ideal which provide reliable and lossless communication links between the server and mobile clients. Unfortunately, the performance of FL highly depends on the quality of wireless channels. In this paper, we consider FL in non-ideal wireless channels with transmission outage (TO) and quantization errors (QE). We analytically show that both TO and QE have significant impacts on the FL and can lead the FL algorithm to a biased solution if the clients have heterogeneous TO probabilities. In view of this, we propose a robust FL scheme which performs joint bandwidth and quantization bit allocation across clients to achieve robust FL performance in such non-ideal wireless channels. Extensive experimental results are presented to show the superior performance of the proposed scheme for a deep learning-based classification task with training latency constraints.
引用
收藏
页码:586 / 590
页数:5
相关论文
共 15 条
[1]   Update Aware Device Scheduling for Federated Learning at the Wireless Edge [J].
Amiri, Mohammad Mohammadi ;
Gunduz, Deniz ;
Kulkarni, Sanjeev R. ;
Poor, H. Vincent .
2020 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2020, :2598-2603
[2]   A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks [J].
Chen, Mingzhe ;
Yang, Zhaohui ;
Saad, Walid ;
Yin, Changchuan ;
Poor, H. Vincent ;
Cui, Shuguang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) :269-283
[3]   Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems [J].
Figueiredo, Mario A. T. ;
Nowak, Robert D. ;
Wright, Stephen J. .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2007, 1 (04) :586-597
[4]  
Goldsmith A., 2005, Wireless Communications
[5]  
Karimireddy SP, 2020, PR MACH LEARN RES, V119
[6]  
Li T., 2018, arXiv preprint arXiv:1812.06127
[7]  
McMahan HB, 2017, PR MACH LEARN RES, V54, P1273
[8]  
Reisizadeh A, 2020, PR MACH LEARN RES, V108, P2021
[9]   Robust and Communication-Efficient Federated Learning From Non-i.i.d. Data [J].
Sattler, Felix ;
Wiedemann, Simon ;
Mueller, Klaus-Robert ;
Samek, Wojciech .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (09) :3400-3413
[10]   Device Scheduling with Fast Convergence for Wireless Federated Learning [J].
Shi, Wenqi ;
Zhou, Sheng ;
Niu, Zhisheng .
ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,