Joint Pre-Equalization and Receiver Combining Design for Federated Learning With Misaligned Over-the-Air Computation

被引:1
作者
Wang, Jianda [1 ,2 ]
Guo, Shuaishuai [1 ,2 ]
机构
[1] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[2] Shandong Univ, Shandong Key Lab Wireless Commun Technol, Jinan 250061, Peoples R China
来源
IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY | 2023年 / 4卷
基金
中国国家自然科学基金;
关键词
Receivers; Fading channels; Transmitters; Maximum likelihood estimation; Data models; Training; Federated learning; multiple access channels; over-the-air computation; asynchronous; pre-equalization; receiver combining; successive convex approximation; ANALOG FUNCTION COMPUTATION; WIRELESS EDGE;
D O I
10.1109/OJCOMS.2023.3328931
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the growth of terminal devices and data traffic, privacy concerns have inspired an innovative edge learning framework, called federated learning (FL). Over-the-air computation (OAC) has been introduced to reduce communication overhead for FL, however, requires stringent time alignment. Misaligned OAC has been proposed by recent research where the symbol-timing misaligned superimposed signal can be recovered via whitening matched filtering and sampling (WMFS), followed by maximum likelihood (ML) estimation. Similarly to aligned OAC, misaligned OAC also suffers from the straggler issue, leading to FL's poor performance under low EsN0. To solve this issue, we propose a novel framework of misaligned OAC FL for accurate model aggregation on wireless networks. First, we analyze the effect of aggregation error on the convergence of FL. Then, we formulate an optimization problem to minimize the distortion of the aggregation measured by mean square error (MSE) w.r.t. the transmitter equalization and receiver combining. Finally, a successive convex approximation (SCA)-based optimization algorithm is further developed to solve the resulting quadratic constrained quadratic programming. Comprehensive experiments show that the proposed algorithm achieves substantial learning performance improvement compared to existing baseline schemes and achieves the near-optimal performance of the ideal benchmark with aligned and noiseless aggregation.
引用
收藏
页码:2881 / 2896
页数:16
相关论文
共 48 条
[1]  
Abari Omid, 2015, 2015 IEEE Conference on Computer Communications (INFOCOM). Proceedings, P1742, DOI 10.1109/INFOCOM.2015.7218555
[2]  
Adeli MH, 2022, IEEE ICC, P4944, DOI 10.1109/ICC45855.2022.9839037
[3]  
Aji Alham Fikriand, 2017, P 2017 C EMP METH NA, DOI DOI 10.18653/V1/D17-1045
[4]  
Alistarh D, 2017, ADV NEUR IN, V30
[5]  
Amiri M. M., 2019, PROC IEEE WORKSHOP S, P1
[6]   Blind Federated Edge Learning [J].
Amiri, Mohammad Mohammadi ;
Duman, Tolga M. ;
Gunduz, Deniz ;
Kulkarni, Sanjeev R. ;
Poor, H. Vincent .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (08) :5129-5143
[7]   Federated Learning Over Wireless Fading Channels [J].
Amiri, Mohammad Mohammadi ;
Gunduz, Deniz .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (05) :3546-3557
[8]   Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air [J].
Amiri, Mohammad Mohammadi ;
Gunduz, Deniz .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 (68) :2155-2169
[9]   Collaborative Machine Learning at the Wireless Edge with Blind Transmitters [J].
Amiri, Mohammad Mohammadi ;
Duman, Tolga M. ;
Gunduz, Deniz .
2019 7TH IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (IEEE GLOBALSIP), 2019,
[10]   Optimal MIMO Combining for Blind Federated Edge Learning with Gradient Sparsification [J].
Becirovic, Ema ;
Chen, Zheng ;
Larsson, Erik G. .
2022 IEEE 23RD INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATION (SPAWC), 2022,