Dynamic Client Selection for Over-the-Air Federated Learning Network

被引:0
作者
Shi, Fang [1 ]
Lin, Weiwei [2 ,3 ]
Peng, Chaoda [1 ]
Zhong, Cankun [1 ]
Wang, Dong [1 ]
Cheng, Mingyue [1 ]
机构
[1] South China Agr Univ, Coll Math & Informat, Guangzhou 510006, Peoples R China
[2] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518066, Peoples R China
基金
中国国家自然科学基金;
关键词
Training; Computational modeling; Wireless networks; Atmospheric modeling; Servers; Analytical models; Data models; Propagation losses; Noise; Performance evaluation; Client selection; federated learning (FL); mean-squared-error (MSE) constraint; over-the-air computation; COMPUTATION;
D O I
10.1109/JIOT.2024.3523947
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As a privacy-preserving solution, federated learning (FL) demonstrates great potential in distributed model training, but limited bandwidth, particularly in near-field communication (NFC)-based systems, emerges as a key bottleneck by restricting the number of participating clients. To address this challenge, over-the-air FL leverages the superposition property of wireless multiple-access channels, enabling faster model training and accommodating more clients, even in bandwidth-constrained scenarios like NFC. However, due to its analog-integrated nature, the FL performance is also affected by other factors, such as channel noise. These motivate us to consider how the selected client set and channel noise affect FL performance. To explore this concern, in this article, we consider an over-the-air FL system with analog gradient aggregation and analyze the impact of the selected client set and channel noise on FL training performance. The theoretical analysis effectively shows the importance of the clients' number and the power scaling factor to the FL training performance. Based on the theoretical analysis, we transform the global optimization problem into the client selection problem and propose a dynamic client selection scheme to optimize the training performance under the aggregation error constraint. Experimental results demonstrate that our proposed scheme can boost FL by speeding up the convergence of the global model (at least 35%) and saving energy consumption.
引用
收藏
页码:18508 / 18519
页数:12
相关论文
共 37 条
[1]   Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air [J].
Amiri, Mohammad Mohammadi ;
Gunduz, Deniz .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 (68) :2155-2169
[2]   An Overview on Over-the-Air Federated Edge Learning [J].
Cao, Xiaowen ;
Lyu, Zhonghao ;
Zhu, Guangxu ;
Xu, Jie ;
Xu, Lexi ;
Cui, Shuguang .
IEEE WIRELESS COMMUNICATIONS, 2024, 31 (03) :202-210
[3]   Optimized Power Control for Over-the-Air Computation in Fading Channels [J].
Cao, Xiaowen ;
Zhu, Guangxu ;
Xu, Jie ;
Huang, Kaibin .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (11) :7498-7513
[4]   Over-the-Air Computation for IoT Networks: Computing Multiple Functions With Antenna Arrays [J].
Chen, Li ;
Zhao, Nan ;
Chen, Yunfei ;
Yu, F. Richard ;
Wei, Guo .
IEEE INTERNET OF THINGS JOURNAL, 2018, 5 (06) :5296-5306
[5]   Distributed Learning in Wireless Networks: Recent Progress and Future Challenges [J].
Chen, Mingzhe ;
Gunduz, Deniz ;
Huang, Kaibin ;
Saad, Walid ;
Bennis, Mehdi ;
Feljan, Aneta Vulgarakis ;
Poor, H. Vincent .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (12) :3579-3605
[6]  
Cohen G, 2017, IEEE IJCNN, P2921, DOI 10.1109/IJCNN.2017.7966217
[7]   The Survey on Near Field Communication [J].
Coskun, Vedat ;
Ozdenizci, Busra ;
Ok, Kerem .
SENSORS, 2015, 15 (06) :13348-13405
[8]   Joint Device Selection and Power Control for Wireless Federated Learning [J].
Guo, Wei ;
Li, Ran ;
Huang, Chuan ;
Qin, Xiaoqi ;
Shen, Kaiming ;
Zhang, Wei .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2022, 40 (08) :2395-2410
[9]   HoloFed: Environment-Adaptive Positioning via Multi-Band Reconfigurable Holographic Surfaces and Federated Learning [J].
Hu, Jingzhi ;
Chen, Zhe ;
Zheng, Tianyue ;
Schober, Robert ;
Luo, Jun .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (12) :3736-3751
[10]   Stochastic Client Selection for Federated Learning With Volatile Clients [J].
Huang, Tiansheng ;
Lin, Weiwei ;
Shen, Li ;
Li, Keqin ;
Zomaya, Albert Y. .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (20) :20055-20070