One-Bit Aggregation for Over-the-Air Federated Learning Against Byzantine Attacks

被引:1
作者
Miao, Yifan [1 ]
Ni, Wanli [2 ,3 ]
Tian, Hui [1 ]
机构
[1] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
[2] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
[3] Beijing Natl Res Ctr Informat Sci & Technol, Beijing 100084, Peoples R China
关键词
Vectors; Quantization (signal); Atmospheric modeling; Symbols; OFDM; Wireless networks; Numerical models; Federated learning; over-the-air computation; Byzantine attack; gradient quantization; majority vote;
D O I
10.1109/LSP.2024.3384077
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
To facilitate distributed machine learning in wireless networks, over-the-air federated learning (AirFL) is proposed to provide data privacy protection and high communication efficiency by leveraging the superposition property of wireless channels. However, as a typical parameter attack method, Byzantine attack brings challenges to the stable operation of AirFL systems. In this letter, we integrate orthogonal frequency division multiplexing and SignSGD with majority vote to enhance the resilience of AirFL against Byzantine attacks by performing one-bit gradient quantization. Theoretical analysis and numerical simulations are provided to validate the effectiveness of the proposed AirFL scheme under different channel states and Byzantine attacker percentages.
引用
收藏
页码:1024 / 1028
页数:5
相关论文
共 21 条
[1]   Federated Learning Over Wireless Fading Channels [J].
Amiri, Mohammad Mohammadi ;
Gunduz, Deniz .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (05) :3546-3557
[2]   Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air [J].
Amiri, Mohammad Mohammadi ;
Gunduz, Deniz .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 (68) :2155-2169
[3]  
Bernstein J, 2018, PR MACH LEARN RES, V80
[4]  
Blanchard P, 2017, ADV NEUR IN, V30
[5]   BEV-SGD: Best Effort Voting SGD Against Byzantine Attacks for Analog-Aggregation-Based Federated Learning Over the Air [J].
Fan, Xin ;
Wang, Yue ;
Huo, Yan ;
Tian, Zhi .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (19) :18946-18959
[6]  
Huang Y., 2021, IEEE INT CONFCOMMUN, P1
[7]   Communication Efficient Federated Learning With Energy Awareness Over Wireless Networks [J].
Jin, Richeng ;
He, Xiaofan ;
Dai, Huaiyu .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (07) :5204-5219
[8]   One Bit Aggregation for Federated Edge Learning With Reconfigurable Intelligent Surface: Analysis and Optimization [J].
Li, Heju ;
Wang, Rui ;
Zhang, Wei ;
Wu, Jun .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2023, 22 (02) :872-888
[9]   Federated Learning: Challenges, Methods, and Future Directions [J].
Li, Tian ;
Sahu, Anit Kumar ;
Talwalkar, Ameet ;
Smith, Virginia .
IEEE SIGNAL PROCESSING MAGAZINE, 2020, 37 (03) :50-60
[10]   Federated Learning in Mobile Edge Networks: A Comprehensive Survey [J].
Lim, Wei Yang Bryan ;
Nguyen Cong Luong ;
Dinh Thai Hoang ;
Jiao, Yutao ;
Liang, Ying-Chang ;
Yang, Qiang ;
Niyato, Dusit ;
Miao, Chunyan .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2020, 22 (03) :2031-2063