Analog Over-the-Air Federated Learning with Real-World Data

被引:0
作者
Chen, Zihan [1 ]
Li, Zeshen [2 ]
Xu, Jingyi [1 ]
机构
[1] Singapore Univ Technol & Design, ISTD Pillar, Singapore, Singapore
[2] Zhejiang Univ, ZJUI Inst, Haining, Peoples R China
来源
2022 IEEE INTERNATIONAL CONFERENCE ON SENSING, COMMUNICATION, AND NETWORKING (SECON WORKSHOPS) | 2022年
关键词
analog over the air computation; federated learning; real-world data; interference; label noise;
D O I
10.1109/SECONWORKSHOPS56311.2022.9926339
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Federated edge learning enables intelligence services to be deployed at the edge of future wireless network. To address the limited spectral resource and constrained scalability, analog over-the-air federated learning is recently proposed to achieve fast aggregations with enhanced spectral efficiency, privacy and concurrent reduced access latency, via exploiting the superposition property of wireless waveforms. From a practical aspect of real-world data, noisy label quality commonly exists in local data of diverse clients in a heterogeneous wireless network, which would possibly result in performance degradation. In this work, we are the first to explore the overall effects of the interference in the random channel and the noisy labels in local datasets. A comprehensive framework to generate distributed data with discrepancies in data heterogeneity and quality is introduced. We then illustrate the overall effects of both noisy data and channel interference. The numerical results indicate that the two-sided effect also exists in this real-world system. More importantly, the potential positive effect brought by the uncertainty and randomness, could be further investigated for better utilization of the channel interference to improve the robustness of analog over-the-air federated edge learning with real-world data.
引用
收藏
页码:31 / 36
页数:6
相关论文
共 25 条
[1]  
Durmus AE, 2021, INT C LEARNING REPRE
[2]   Harnessing Wireless Channels for Scalable and Privacy-Preserving Federated Learning [J].
Elgabli, Anis ;
Park, Jihong ;
Ben Issaid, Chaouki ;
Bennis, Mehdi .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (08) :5194-5208
[3]  
Geyer R. C., 2017, arXiv
[4]   Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labels [J].
Han, Bo ;
Yao, Quanming ;
Yu, Xingrui ;
Niu, Gang ;
Xu, Miao ;
Hu, Weihua ;
Tsang, Ivor W. ;
Sugiyama, Masashi .
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
[5]  
Hsu TMH, 2019, Arxiv, DOI [arXiv:1909.06335, DOI 10.48550/ARXIV.1909.06335, 10.48550/arXiv.1909.06335]
[6]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[7]   Federated Visual Classification with Real-World Data Distribution [J].
Hsu, Tzu-Ming Harry ;
Qi, Hang ;
Brown, Matthew .
COMPUTER VISION - ECCV 2020, PT X, 2020, 12355 :76-92
[8]  
Krizhevsky A., 2012, Handbook Syst. Autoimmune Dis
[9]   Gradient-based learning applied to document recognition [J].
Lecun, Y ;
Bottou, L ;
Bengio, Y ;
Haffner, P .
PROCEEDINGS OF THE IEEE, 1998, 86 (11) :2278-2324
[10]  
Li T, 2021, PR MACH LEARN RES, V139