AFL: Adaptive Federated Learning Based on Personalized Model and Adaptive Communication

被引:0
|
作者
Wu, Xing [1 ]
Liu, Fei Xiang [1 ]
Zhao, Yue [2 ]
Zhao, Ming [3 ]
机构
[1] Shanghai Univ, Sch Comp Engn & Sci, Shanghai, Peoples R China
[2] Northwest Univ Technol, Sch Software, Taicang, Jiangsu, Peoples R China
[3] CSSC Ocean Explorat Technol Inst Co Ltd, Shanghai, Peoples R China
来源
NEW TRENDS IN INTELLIGENT SOFTWARE METHODOLOGIES, TOOLS AND TECHNIQUES | 2021年 / 337卷
关键词
federated learning; FedAvg; privacy preserving; machine learning; non-iid dataset;
D O I
10.3233/FAIA210035
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Federated learning (FL) has given indications of being effective as a architecture for distributed machine learning, which can ensure the data security for each client and train the global deep learning model. Due to the rapid development of this technology, issues remain to be fully explored. Among them, the robustness of the system, privacy protection and communication efficiency are the key factors affecting quality of FL. Here we propose a new FL model based on personalized model and adaptive communication, called Adaptive Federated Learning (AFL). Our model mainly uses two mechanisms: a) Each client trains the personalized local model according to its own local data set; b) Adaptive chain communication mode is adopted in federation aggregation to reduce the time spent in synchronizing training result. A large number of experiments on two public datasets: MNIST and CIFAR10 show that our model is more accurate by over 5% compared with the FedAvg, and is also faster by over 10% compared with Chain-PPFL, which provides a very important significance in theory and practical production.
引用
收藏
页码:359 / 366
页数:8
相关论文
共 50 条
  • [1] PerFreezeClip: Personalized Federated Learning Based on Adaptive Clipping
    Zhang, Jianfei
    Liu, Zhilin
    ELECTRONICS, 2024, 13 (14)
  • [2] Personalized Federated Learning Incorporating Adaptive Model Pruning at the Edge
    Zhou, Yueying
    Duan, Gaoxiang
    Qiu, Tianchen
    Zhang, Lin
    Tian, Li
    Zheng, Xiaoying
    Zhu, Yongxin
    ELECTRONICS, 2024, 13 (09)
  • [3] Personalized Federated Learning With Adaptive Batchnorm for Healthcare
    Lu, Wang
    Wang, Jindong
    Chen, Yiqiang
    Qin, Xin
    Xu, Renjun
    Dimitriadis, Dimitrios
    Qin, Tao
    IEEE TRANSACTIONS ON BIG DATA, 2024, 10 (06) : 915 - 925
  • [4] Computation and Communication Efficient Federated Learning With Adaptive Model Pruning
    Jiang, Zhida
    Xu, Yang
    Xu, Hongli
    Wang, Zhiyuan
    Liu, Jianchun
    Chen, Qian
    Qiao, Chunming
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (03) : 2003 - 2021
  • [5] Enhancing Decentralized Federated Learning With Model Pruning and Adaptive Communication
    Xu, Yin
    Xiao, Mingjun
    Wu, Jie
    Gao, Guoju
    Li, Datian
    Xu, Haotian
    Zhang, Tongxiao
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2025, 21 (01) : 70 - 84
  • [6] Personalized Federated Learning Based Adaptive Optical Compensation for Atmospheric Turbulence
    Song, Song
    He, Qiao
    Liu, Yejun
    Wu, Po
    Sun, Qiming
    Zhao, Lun
    Wu, Tingwei
    Guo, Lei
    JOURNAL OF LIGHTWAVE TECHNOLOGY, 2025, 43 (01) : 177 - 189
  • [7] Sketch-Based Adaptive Communication Optimization in Federated Learning
    Zhang, Pan
    Xu, Lei
    Mei, Lin
    Xu, Chungen
    IEEE TRANSACTIONS ON COMPUTERS, 2025, 74 (01) : 170 - 184
  • [8] Dynamic Personalized Federated Learning with Adaptive Differential Privacy
    Yang, Xiyuan
    Huang, Wenke
    Ye, Mang
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [9] FedALA: Adaptive Local Aggregation for Personalized Federated Learning
    Zhang, Jianqing
    Hua, Yang
    Wang, Hao
    Song, Tao
    Xue, Zhengui
    Ma, Ruhui
    Guan, Haibing
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 9, 2023, : 11237 - 11244
  • [10] Local Adaptive Federated Learning with Channel Personalized Normalization
    Zhao, Yu
    Chen, Siguang
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2024, 46 (08): : 3174 - 3183