Dynamic Logical Resource Reconstruction against Straggler Problem in Edge Federated Learning

被引:0
|
作者
Li, Kaiju [1 ]
Wang, Ha [2 ,3 ]
Mu, Xuejia [2 ,3 ]
Chen, Xian [4 ]
Shin, Hyoseop [5 ]
机构
[1] Guizhou Univ Finance & Econ, Sch Informat, Guiyang, Guizhou, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Coll Comp Sci & Technol, Chongqing, Peoples R China
[3] Minist Culture & Tourism, Key Lab Tourism Multisource Data Percept & Decis, Chongqing, Peoples R China
[4] Konkuk Univ, Data Sci Lab, Seoul, South Korea
[5] Konkuk Univ, Div Comp Sci & Engn, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Edge Computing; Federated Learning; Straggler Effect; Communication Efficiency; Resource Balance;
D O I
10.22967/HCIS.2024.14.025
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning enables edge distributed devices to learn a shared global model without violating privacy concerns. However, due to the heterogeneity in data or resources across devices, the straggler issue has become a key bottleneck for effective federated learning. As aggregation methods favor faster devices, these methods may introduce biases and severely degrade model accuracy. To solve these challenges, we propose FedDRB, a unique federated learning communication framework via dynamic resource balancing, including a dynamic logical cluster construction (DLCC) algorithm and a weighted intra-cluster collaborative (WICC) aggregation algorithm. To shorten total model training time, DLCC divides all edge devices into several logical clusters and constructs a tiered structure. In addition, WICC requires faster devices to assist the training of slower devices and assigns a relatively higher weight to slower devices during the aggregation stage, hence accelerating the intra-cluster convergence speed and ensuring training model accuracy. Compared with stateof-the-art federated learning approaches, experimental results demonstrate that FedDRB improves prediction accuracy by up to 12.60% and reduces the required communication cost by up to 9.78x.
引用
收藏
页数:23
相关论文
共 50 条
  • [1] Provision for Energy: A Resource Allocation Problem in Federated Learning for Edge Systems
    Liu, Mingyue
    Rajamanickam, Leelavathi
    Parthasarathy, Rajamohan
    EAI Endorsed Transactions on Energy Web, 2024, 11
  • [2] DYNAMIC RESOURCE OPTIMIZATION FOR ADAPTIVE FEDERATED LEARNING AT THE WIRELESS NETWORK EDGE
    Di Lorenzo, Paolo
    Battiloro, Claudio
    Merluzzi, Mattia
    Barbarossa, Sergio
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 4910 - 4914
  • [3] Decentralized Edge Intelligence: A Dynamic Resource Allocation Framework for Hierarchical Federated Learning
    Lim, Wei Yang Bryan
    Ng, Jer Shyuan
    Xiong, Zehui
    Jin, Jiangming
    Zhang, Yang
    Niyato, Dusit
    Leung, Cyril
    Miao, Chunyan
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (03) : 536 - 550
  • [4] Resource management at the network edge for federated learning
    Trindade, Silvana
    Bittencourt, Luiz F.
    da Fonseca, Nelson L. S.
    DIGITAL COMMUNICATIONS AND NETWORKS, 2024, 10 (03) : 765 - 782
  • [5] Resource management at the network edge for federated learning
    Silvana Trindade
    Luiz F.Bittencourt
    Nelson L.S.da Fonseca
    Digital Communications and Networks, 2024, 10 (03) : 765 - 782
  • [6] Dynamic Resource Management for Federated Edge Learning With Imperfect CSI: A Deep Reinforcement Learning Approach
    Zhou, Sheng
    Feng, Li
    Mei, Muyu
    Yao, Mingwu
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (18): : 30400 - 30412
  • [7] Straggler-aware Federated Learning based on Adaptive Clustering to Support Edge Intelligence
    Liu, Yi-Jing
    Feng, Gang
    Du, Hongyang
    Qin, Zheng
    Sun, Yao
    Kang, Jiawen
    Niyato, Dusit
    ICC 2024 - IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2024, : 1867 - 1872
  • [8] Adaptive Clustering-Based Straggler-Aware Federated Learning in Wireless Edge Networks
    Liu, Yi-Jing
    Feng, Gang
    Du, Hongyang
    Qin, Zheng
    Sun, Yao
    Kang, Jiawen
    Li, Xiaoqian
    Niyato, Dusit
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2024, 72 (12) : 7757 - 7771
  • [9] Dynamic Resource Allocation for Hierarchical Federated Learning
    Lim, Wei Yang Bryan
    Ng, Jer Shyuan
    Xiong, Zehui
    Niyato, Dusit
    Guo, Song
    Leung, Cyril
    Miao, Chunyan
    2020 16TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING (MSN 2020), 2020, : 153 - 160
  • [10] Dynamic Edge Association and Resource Allocation in Self-Organizing Hierarchical Federated Learning Networks
    Lim, Wei Yang Bryan
    Ng, Jer Shyuan
    Xiong, Zehui
    Niyato, Dusit
    Miao, Chunyan
    Kim, Dong In
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (12) : 3640 - 3653