Over-the-Air Federated Learning with Phase Noise: Analysis and Countermeasures

被引:0
作者
Dahl, Martin [1 ]
Larsson, Erik G. [1 ]
机构
[1] Linkoping Univ, Dept Elect Engn ISY, Linkoping, Sweden
来源
2024 58TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS, CISS | 2024年
基金
瑞典研究理事会;
关键词
Federated learning; Wireless networks; COMPUTATION;
D O I
10.1109/CISS59072.2024.10480215
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Wirelessly connected devices can collaborately train a machine learning model using federated learning, where the aggregation of model updates occurs using over-the-air computation. Carrier frequency offset caused by imprecise clocks in devices will cause the phase of the over-the-air channel to drift randomly, such that late symbols in a coherence block are transmitted with lower quality than early symbols. To mitigate the effect of degrading symbol quality, we propose a scheme where one of the permutations Roll, Flip and Sort are applied on gradients before transmission. Through simulations we show that the permutations can both improve and degrade learning performance. Furthermore, we derive the expectation and variance of the gradient estimate, which is shown to grow exponentially with the number of symbols in a coherence block.
引用
收藏
页数:6
相关论文
共 26 条
  • [11] Not All Layers Are Equal: A Layer-Wise Adaptive Approach Toward Large-Scale DNN Training
    Ko, Yunyong
    Lee, Dongwon
    Kim, Sang-Wook
    [J]. PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 1851 - 1859
  • [12] LeCun Y., 2010, ATT Labs Online
  • [13] McMahan HB, 2017, PR MACH LEARN RES, V54, P1273
  • [14] Optimized Over-the-Air Computation for Wireless Control Systems
    Park, Pangun
    Di Marco, Piergiuseppe
    Fischione, Carlo
    [J]. IEEE COMMUNICATIONS LETTERS, 2022, 26 (02) : 424 - 428
  • [15] Effects of phase noise on OFDM systems with and without PLL: Characterization and compensation
    Petrovic, Denis
    Rave, Wolfgang
    Fettweis, Gerhard
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 2007, 55 (08) : 1607 - 1616
  • [17] A Survey on Over-the-Air Computation
    Sahin, Alphan
    Yang, Rui
    [J]. IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2023, 25 (03): : 1877 - 1908
  • [18] On Analog Gradient Descent Learning Over Multiple Access Fading Channels
    Sery, Tomer
    Cohen, Kobi
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 : 2897 - 2911
  • [19] Bayesian Over-the-Air Computation
    Shao, Yulin
    Gunduz, Deniz
    Liew, Soung Chang
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (03) : 589 - 606
  • [20] Federated Edge Learning With Misaligned Over-the-Air Computation
    Shao, Yulin
    Gunduz, Deniz
    Liew, Soung Chang
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (06) : 3951 - 3964