HFL-GAN: scalable hierarchical federated learning GAN for high quantity heterogeneous clients

被引:0
作者
Petch, Lewis [1 ]
Moustafa, Ahmed [1 ]
Ma, Xinhui [1 ]
Yasser, Mohammad [2 ]
机构
[1] Univ Hull, Comp Sci, Kingston Upon Hull HU6 7RX, England
[2] NEC Corp Tokyo, Tokyo, Japan
关键词
Federated learning; Generative adversarial network; Non-IID; Hierarchical learning;
D O I
10.1007/s10489-024-05924-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper introduces a novel approach for training generative adversarial networks using federated machine learning. Generative adversarial networks have gained plenty of attention in the research community especially with their abilities to produce high quality synthetic data for a variety of use-cases. Yet, when combined with federated learning, those models suffer from degradation in both training time and quality of results. To address this challenge, this paper introduces a novel approach that uses hierarchical learning techniques to enable the efficient training of federated GAN models. The proposed approach introduces an innovative mechanism that dynamically clusters participant clients to edge servers as well as a novel multi-generator GAN architecture that utilizes non-identical model aggregation stages. The proposed approach has been evaluated on a number of benchmark datasets to measure its performance on higher numbers of participating clients. The results show that HFL-GAN outperforms other comparative state-of-the-art approaches in the training of GAN models in complex non-IID federated learning settings.
引用
收藏
页数:16
相关论文
共 31 条
[1]  
Abdellatif AA, 2022, Communication-efficient hierarchical federated learning for IoT heterogeneous systems with imbalanced data, V128, P406, DOI [10.1016/j.future.2021.10.016, DOI 10.1016/J.FUTURE.2021.10.016]
[2]  
Al-Rubaie M, 2019, Threats and solutions, V17, P49, DOI [10.1109/MSEC.2018.2888775, DOI 10.1109/MSEC.2018.2888775]
[3]  
Biswas A, 2023, Generative adversarial networks for data augmentation
[4]  
Briggs C, 2020, Arxiv, DOI [arXiv:2004.11791, DOI 10.48550/ARXIV.2004.11791]
[5]  
Cho Y.J., 2020, ARXIV
[6]  
Fui-Hoon Nah F., 2023, Generative AI and ChatGPT: applications, challenges, and AI-human collaboration, V25, P277, DOI DOI 10.1080/15228053.2023.22338
[7]   FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correction [J].
Gao, Liang ;
Fu, Huazhu ;
Li, Li ;
Chen, Yingwen ;
Xu, Ming ;
Xu, Cheng-Zhong .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, :10102-10111
[8]  
Ghosh A, 2018, Arxiv, DOI arXiv:1704.02906
[9]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[10]   MD-GAN: Multi-Discriminator Generative Adversarial Networks for Distributed Datasets [J].
Hardy, Corentin ;
Le Merrer, Erwan ;
Sericola, Bruno .
2019 IEEE 33RD INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS 2019), 2019, :866-877