Dynamic Logical Resource Reconstruction against Straggler Problem in Edge Federated Learning

被引:0
|
作者
Li, Kaiju [1 ]
Wang, Ha [2 ,3 ]
Mu, Xuejia [2 ,3 ]
Chen, Xian [4 ]
Shin, Hyoseop [5 ]
机构
[1] Guizhou Univ Finance & Econ, Sch Informat, Guiyang, Guizhou, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Coll Comp Sci & Technol, Chongqing, Peoples R China
[3] Minist Culture & Tourism, Key Lab Tourism Multisource Data Percept & Decis, Chongqing, Peoples R China
[4] Konkuk Univ, Data Sci Lab, Seoul, South Korea
[5] Konkuk Univ, Div Comp Sci & Engn, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Edge Computing; Federated Learning; Straggler Effect; Communication Efficiency; Resource Balance;
D O I
10.22967/HCIS.2024.14.025
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning enables edge distributed devices to learn a shared global model without violating privacy concerns. However, due to the heterogeneity in data or resources across devices, the straggler issue has become a key bottleneck for effective federated learning. As aggregation methods favor faster devices, these methods may introduce biases and severely degrade model accuracy. To solve these challenges, we propose FedDRB, a unique federated learning communication framework via dynamic resource balancing, including a dynamic logical cluster construction (DLCC) algorithm and a weighted intra-cluster collaborative (WICC) aggregation algorithm. To shorten total model training time, DLCC divides all edge devices into several logical clusters and constructs a tiered structure. In addition, WICC requires faster devices to assist the training of slower devices and assigns a relatively higher weight to slower devices during the aggregation stage, hence accelerating the intra-cluster convergence speed and ensuring training model accuracy. Compared with stateof-the-art federated learning approaches, experimental results demonstrate that FedDRB improves prediction accuracy by up to 12.60% and reduces the required communication cost by up to 9.78x.
引用
收藏
页数:23
相关论文
共 50 条
  • [41] Toward Multiple Federated Learning Services Resource Sharing in Mobile Edge Networks
    Nguyen, Minh N. H.
    Tran, Nguyen H.
    Tun, Yan Kyaw
    Han, Zhu
    Hong, Choong Seon
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (01) : 541 - 555
  • [42] Heterogeneous Computation and Resource Allocation for Wireless Powered Federated Edge Learning Systems
    Feng, Jie
    Zhang, Wenjing
    Pei, Qingqi
    Wu, Jinsong
    Lin, Xiaodong
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2022, 70 (05) : 3220 - 3233
  • [43] Private Edge Computing Resource Allocation and Communication Optimization Based on Federated Learning
    Xiao, Ke
    Wang, Jiaxin
    Li, Chaofei
    Yu, Zhenwei
    Gao, Feifei
    2024 23RD IFIP NETWORKING CONFERENCE, IFIP NETWORKING 2024, 2024, : 601 - 606
  • [44] Communication-Efficient Federated Learning for Resource-Constrained Edge Devices
    Lan, Guangchen
    Liu, Xiao-Yang
    Zhang, Yijing
    Wang, Xiaodong
    IEEE Transactions on Machine Learning in Communications and Networking, 2023, 1 : 210 - 224
  • [45] Optimal Device Selection in Federated Learning for Resource-Constrained Edge Networks
    Kushwaha, Deepali
    Redhu, Surender
    Brinton, Christopher G.
    Hegde, Rajesh M.
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (12): : 10845 - 10856
  • [46] Joint Client Selection and Resource Allocation for Federated Learning in Mobile Edge Networks
    Luo, Long
    Cai, Qingqing
    Li, Zonghang
    Yu, Hongfang
    2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 1218 - 1223
  • [47] Joint client selection and resource allocation for federated edge learning with imperfect CSI
    Zhou, Sheng
    Wang, Liangmin
    Wu, Weihua
    Feng, Li
    COMPUTER NETWORKS, 2025, 257
  • [48] The Resource Problem of Using Linear Layer Leakage Attack in Federated Learning
    Zhao, Joshua. C.
    Elkordy, Ahmed Roushdy
    Sharma, Atul
    Ezzeldin, Yahya H.
    Avestimehr, Salman
    Bagchi, Saurabh
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 3974 - 3983
  • [49] Adaptive Batch Size for Federated Learning in Resource-Constrained Edge Computing
    Ma, Zhenguo
    Xu, Yang
    Xu, Hongli
    Meng, Zeyu
    Huang, Liusheng
    Xue, Yinxing
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (01) : 37 - 53
  • [50] Federated Learning for Online Resource Allocation in Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Zheng, Jingjing
    Li, Kai
    Mhaisen, Naram
    Ni, Wei
    Tovar, Eduardo
    Guizani, Mohsen
    2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC, 2023,