Over-the-Air Federated Learning with Phase Noise: Analysis and Countermeasures

被引:0
作者
Dahl, Martin [1 ]
Larsson, Erik G. [1 ]
机构
[1] Linkoping Univ, Dept Elect Engn ISY, Linkoping, Sweden
来源
2024 58TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS, CISS | 2024年
基金
瑞典研究理事会;
关键词
Federated learning; Wireless networks; COMPUTATION;
D O I
10.1109/CISS59072.2024.10480215
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Wirelessly connected devices can collaborately train a machine learning model using federated learning, where the aggregation of model updates occurs using over-the-air computation. Carrier frequency offset caused by imprecise clocks in devices will cause the phase of the over-the-air channel to drift randomly, such that late symbols in a coherence block are transmitted with lower quality than early symbols. To mitigate the effect of degrading symbol quality, we propose a scheme where one of the permutations Roll, Flip and Sort are applied on gradients before transmission. Through simulations we show that the permutations can both improve and degrade learning performance. Furthermore, we derive the expectation and variance of the gradient estimate, which is shown to grow exponentially with the number of symbols in a coherence block.
引用
收藏
页数:6
相关论文
共 26 条
[11]   Not All Layers Are Equal: A Layer-Wise Adaptive Approach Toward Large-Scale DNN Training [J].
Ko, Yunyong ;
Lee, Dongwon ;
Kim, Sang-Wook .
PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, :1851-1859
[12]  
LeCun Y., 2010, MNIST handwritten digit database, V2
[13]  
McMahan HB, 2017, PR MACH LEARN RES, V54, P1273
[14]   Optimized Over-the-Air Computation for Wireless Control Systems [J].
Park, Pangun ;
Di Marco, Piergiuseppe ;
Fischione, Carlo .
IEEE COMMUNICATIONS LETTERS, 2022, 26 (02) :424-428
[15]   Effects of phase noise on OFDM systems with and without PLL: Characterization and compensation [J].
Petrovic, Denis ;
Rave, Wolfgang ;
Fettweis, Gerhard .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2007, 55 (08) :1607-1616
[17]   A Survey on Over-the-Air Computation [J].
Sahin, Alphan ;
Yang, Rui .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2023, 25 (03) :1877-1908
[18]   On Analog Gradient Descent Learning Over Multiple Access Fading Channels [J].
Sery, Tomer ;
Cohen, Kobi .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 :2897-2911
[19]   Bayesian Over-the-Air Computation [J].
Shao, Yulin ;
Gunduz, Deniz ;
Liew, Soung Chang .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (03) :589-606
[20]   Federated Edge Learning With Misaligned Over-the-Air Computation [J].
Shao, Yulin ;
Gunduz, Deniz ;
Liew, Soung Chang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (06) :3951-3964