Adaptive Idle Model Fusion in Hierarchical Federated Learning for Unbalanced Edge Regions

被引:2
|
作者
Xu, Jiuyun [1 ]
Fan, Hanfei [1 ]
Wang, Qiqi [1 ]
Jiang, Yinyue [1 ]
Duan, Qiang [2 ]
机构
[1] China Univ Petr East China, Coll Comp Sci & Technol, Qingdao 266580, Peoples R China
[2] Penn State Univ, Informat Sci & Technol Dept, Abington, PA 19001 USA
关键词
Data models; Adaptation models; Training; Federated learning; Computational modeling; Servers; Accuracy; Hierarchical federated learning; non-IID data; client assignment; model fusion;
D O I
10.1109/TNSE.2024.3410275
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Federated learning (FL) has gained attention due to the exponential growth of data. However, the Non-IID nature of local data introduces bias into the global model during training. In mobile IoT scenarios, client mobility can lead to data over-aggregation in the edge region, increasing bias in data distribution among edge regions and affecting global model accuracy. Existing solutions mitigate Non-IID problems but overlook the potential contributions of unselected clients with data capable of offsetting imbalances in edge regions. To fill this gap, we first demonstrate that the unbalanced data distribution in the edge regions is one reason for the degraded accuracy of the global model. Then, we propose a client adaptive assignment hierarchical federated learning framework (CAHFL). CAHFL can quantify clients' contribution by calculating Earth Movement Distance (EMD) between clients and servers and rationally selects idle clients to participate in training. In addition, based on the client's contribution, this paper designs an adaptive idle model feature fusion mechanism to enhance the edge model by adaptively fusing the local features of the idle model. Finally, we have performed simulations using publicly available datasets, and the simulation results indicate that the proposed FL framework improves the training performance compared to existing FL protocols.
引用
收藏
页码:4603 / 4616
页数:14
相关论文
共 50 条
  • [1] Hierarchical Federated Edge Learning With Adaptive Clustering in Internet of Things
    Tian, Yuqing
    Wang, Zhongyu
    Zhang, Zhaoyang
    Jin, Richeng
    Shan, Hangguan
    Wang, Wei
    Quek, Tony Q. S.
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (21): : 34108 - 34122
  • [2] A Hierarchical Federated Learning Model with Adaptive Model Parameter Aggregation
    Chen, Zhuo
    Zhou, Chuan
    Zhou, Yang
    COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2023, 20 (03) : 1037 - 1060
  • [3] Adaptive Model Pruning for Hierarchical Wireless Federated Learning
    Liu, Xiaonan
    Wang, Shiqiang
    Deng, Yansha
    Nallanathan, Arumugam
    2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [4] Adaptive Vertical Federated Learning on Unbalanced Features
    Zhang, Jie
    Guo, Song
    Qu, Zhihao
    Zeng, Deze
    Wang, Haozhao
    Liu, Qifeng
    Zomaya, Albert Y.
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (12) : 4006 - 4018
  • [5] Personalized Federated Learning Incorporating Adaptive Model Pruning at the Edge
    Zhou, Yueying
    Duan, Gaoxiang
    Qiu, Tianchen
    Zhang, Lin
    Tian, Li
    Zheng, Xiaoying
    Zhu, Yongxin
    ELECTRONICS, 2024, 13 (09)
  • [6] A Distributed Hierarchical Deep Computation Model for Federated Learning in Edge Computing
    Zheng, Haifeng
    Gao, Min
    Chen, Zhizhang
    Feng, Xinxin
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (12) : 7946 - 7956
  • [7] Optimized Edge Aggregation for Hierarchical Federated Learning
    Xu, Bo
    Xia, Wenchao
    Wen, Wanli
    Zhao, Haitao
    Zhu, Hongbo
    2021 IEEE 94TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2021-FALL), 2021,
  • [8] VHFL: A Cloud-Edge Model Verification Technique for Hierarchical Federated Learning
    Wu, Tiantong
    Bandara, H. M. N. Dilum
    Yeoh, Phee Lep
    Thilakarathna, Kanchana
    2024 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS, ICC WORKSHOPS 2024, 2024, : 1304 - 1309
  • [9] Adaptive Modulation for Wireless Federated Edge Learning
    Xu, Xinyi
    Yu, Guanding
    Liu, Shengli
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2023, 9 (04) : 1096 - 1109
  • [10] Dynamic Edge Association in Hierarchical Federated Learning Networks
    Lim, Wei Yang Bryan
    Ng, Jer Shyuan
    Xiong, Zehui
    Garg, Sahil
    Zhang, Yang
    Niyato, Dusit
    Miao, Chunyan
    2021 IEEE 20TH INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS (TRUSTCOM 2021), 2021, : 1124 - 1131