Dynamic Logical Resource Reconstruction against Straggler Problem in Edge Federated Learning

被引:0
|
作者
Li, Kaiju [1 ]
Wang, Ha [2 ,3 ]
Mu, Xuejia [2 ,3 ]
Chen, Xian [4 ]
Shin, Hyoseop [5 ]
机构
[1] Guizhou Univ Finance & Econ, Sch Informat, Guiyang, Guizhou, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Coll Comp Sci & Technol, Chongqing, Peoples R China
[3] Minist Culture & Tourism, Key Lab Tourism Multisource Data Percept & Decis, Chongqing, Peoples R China
[4] Konkuk Univ, Data Sci Lab, Seoul, South Korea
[5] Konkuk Univ, Div Comp Sci & Engn, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Edge Computing; Federated Learning; Straggler Effect; Communication Efficiency; Resource Balance;
D O I
10.22967/HCIS.2024.14.025
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning enables edge distributed devices to learn a shared global model without violating privacy concerns. However, due to the heterogeneity in data or resources across devices, the straggler issue has become a key bottleneck for effective federated learning. As aggregation methods favor faster devices, these methods may introduce biases and severely degrade model accuracy. To solve these challenges, we propose FedDRB, a unique federated learning communication framework via dynamic resource balancing, including a dynamic logical cluster construction (DLCC) algorithm and a weighted intra-cluster collaborative (WICC) aggregation algorithm. To shorten total model training time, DLCC divides all edge devices into several logical clusters and constructs a tiered structure. In addition, WICC requires faster devices to assist the training of slower devices and assigns a relatively higher weight to slower devices during the aggregation stage, hence accelerating the intra-cluster convergence speed and ensuring training model accuracy. Compared with stateof-the-art federated learning approaches, experimental results demonstrate that FedDRB improves prediction accuracy by up to 12.60% and reduces the required communication cost by up to 9.78x.
引用
收藏
页数:23
相关论文
共 50 条
  • [21] Adaptive Asynchronous Federated Learning in Resource-Constrained Edge Computing
    Liu, Jianchun
    Xu, Hongli
    Wang, Lun
    Xu, Yang
    Qian, Chen
    Huang, Jinyang
    Huang, He
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (02) : 674 - 690
  • [22] Vehicle Selection and Resource Optimization for Federated Learning in Vehicular Edge Computing
    Xiao, Huizi
    Zhao, Jun
    Pei, Qingqi
    Feng, Jie
    Liu, Lei
    Shi, Weisong
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (08) : 11073 - 11087
  • [23] Energy-Efficient Radio Resource Allocation for Federated Edge Learning
    Zeng, Qunsong
    Du, Yuqing
    Huang, Kaibin
    Leung, Kin K.
    2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2020,
  • [24] Joint User Selection and Resource Allocation for Fast Federated Edge Learning
    JIANG Zhihui
    HE Yinghui
    YU Guanding
    ZTECommunications, 2020, 18 (02) : 20 - 30
  • [25] Resource Allocation for Wireless Federated Edge Learning based on Data Importance
    He, Yinghui
    Ren, Jinke
    Yu, Guanding
    Yuan, Jiantao
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [26] Toward Resource-Efficient Federated Learning in Mobile Edge Computing
    Yu, Rong
    Li, Peichun
    IEEE NETWORK, 2021, 35 (01): : 148 - 155
  • [27] Resource Consumption for Supporting Federated Learning Enabled Network Edge Intelligence
    Liu, Yi-Jing
    Feng, Gang
    Sun, Yao
    Li, Xiaoqian
    Zhou, Jianhong
    Qin, Shuang
    2022 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2022, : 49 - 54
  • [28] Resource-Efficient Federated Learning with Hierarchical Aggregation in Edge Computing
    Wang, Zhiyuan
    Xu, Hongli
    Liu, Jianchun
    Huang, He
    Qiao, Chunming
    Zhao, Yangming
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2021), 2021,
  • [29] Device Sampling and Resource Optimization for Federated Learning in Cooperative Edge Networks
    Wang, Su
    Morabito, Roberto
    Hosseinalipour, Seyyedali
    Chiang, Mung
    Brinton, Christopher G.
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2024, 32 (05) : 4365 - 4381
  • [30] A Comprehensive Survey on Joint Resource Allocation Strategies in Federated Edge Learning
    Zhang, Jingbo
    Wu, Qiong
    Fan, Pingyi
    Fan, Qiang
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 81 (02): : 1953 - 1998