Robust Federated Learning Over Noisy Fading Channels

被引:4
作者
Shah, Suhail M. M. [1 ]
Su, Liqun [1 ]
Lau, Vincent K. N. [1 ]
机构
[1] Hong Kong Univ Sci & Technol, Dept Elect & Comp Engn, Hong Kong, Peoples R China
关键词
Training; Convergence; Fading channels; Noise measurement; Standards; Optimization; Servers; Channel noise; federated averaging (FedAvg); federated learning (FL); transmission power optimization; wireless machine learning (ML); ANALOG FUNCTION COMPUTATION; STOCHASTIC-APPROXIMATION;
D O I
10.1109/JIOT.2022.3230452
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The performance capabilities of models trained in a federated learning (FL) setting over wireless networks can be significantly affected by the underlying properties of the transmission channel. Even for shallow models, there can be an acute degradation in performance which necessitates the development of algorithms which are robust to transmission channel effects, such as noise and fading. In this work, we present a two-pronged approach to overcome the limitations of existing wireless machine learning (ML)-based algorithms. First, to tackle the effect of channel noise, we incorporate a novel tracking-based stochastic approximation scheme in the standard federated averaging pipeline which averages out the effect of the channel noise. In contrast to previous works on FL with a noisy channel, we provide exact convergence guarantees for our algorithm without the need to increase the transmission power gain. Second, to combat channel fading and further optimize the power consumption at the client level, we propose an adaptive transmission policy obtained by solving an optimization problem with long-term constraints. The solution is obtained in an online manner via a dual decomposition method. The superior empirical performance of the proposed scheme compared to state-of-the-art works is demonstrated on standard ML tasks.
引用
收藏
页码:7993 / 8013
页数:21
相关论文
共 57 条
  • [1] Abari Omid, 2015, 2015 IEEE Conference on Computer Communications (INFOCOM). Proceedings, P1742, DOI 10.1109/INFOCOM.2015.7218555
  • [2] Aledhari M, 2020, IEEE ACCESS, V8, P140699, DOI [10.1109/ACCESS.2020.3013541, 10.1109/access.2020.3013541]
  • [3] Alistarh D, 2017, ADV NEUR IN, V30
  • [4] Convergence of Federated Learning Over a Noisy Downlink
    Amiri, Mohammad Mohammadi
    Gunduz, Deniz
    Kulkarni, Sanjeev R.
    Poor, H. Vincent
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (03) : 1422 - 1437
  • [5] Federated Learning Over Wireless Fading Channels
    Amiri, Mohammad Mohammadi
    Gunduz, Deniz
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (05) : 3546 - 3557
  • [6] Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air
    Amiri, Mohammad Mohammadi
    Gunduz, Deniz
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 (68) : 2155 - 2169
  • [7] [Anonymous], 2012, NIPS 12
  • [8] Avent B., 2019, arXiv
  • [9] Dynamic Social Learning Under Graph Constraints
    Avrachenkov, Konstantin E.
    Borkar, Vivek S.
    Moharir, Sharayu
    Shah, Suhail
    [J]. IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2022, 9 (03): : 1435 - 1446
  • [10] Bernstein J, 2018, PR MACH LEARN RES, V80