Dynamic Logical Resource Reconstruction against Straggler Problem in Edge Federated Learning

被引:0
|
作者
Li, Kaiju [1 ]
Wang, Ha [2 ,3 ]
Mu, Xuejia [2 ,3 ]
Chen, Xian [4 ]
Shin, Hyoseop [5 ]
机构
[1] Guizhou Univ Finance & Econ, Sch Informat, Guiyang, Guizhou, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Coll Comp Sci & Technol, Chongqing, Peoples R China
[3] Minist Culture & Tourism, Key Lab Tourism Multisource Data Percept & Decis, Chongqing, Peoples R China
[4] Konkuk Univ, Data Sci Lab, Seoul, South Korea
[5] Konkuk Univ, Div Comp Sci & Engn, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Edge Computing; Federated Learning; Straggler Effect; Communication Efficiency; Resource Balance;
D O I
10.22967/HCIS.2024.14.025
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning enables edge distributed devices to learn a shared global model without violating privacy concerns. However, due to the heterogeneity in data or resources across devices, the straggler issue has become a key bottleneck for effective federated learning. As aggregation methods favor faster devices, these methods may introduce biases and severely degrade model accuracy. To solve these challenges, we propose FedDRB, a unique federated learning communication framework via dynamic resource balancing, including a dynamic logical cluster construction (DLCC) algorithm and a weighted intra-cluster collaborative (WICC) aggregation algorithm. To shorten total model training time, DLCC divides all edge devices into several logical clusters and constructs a tiered structure. In addition, WICC requires faster devices to assist the training of slower devices and assigns a relatively higher weight to slower devices during the aggregation stage, hence accelerating the intra-cluster convergence speed and ensuring training model accuracy. Compared with stateof-the-art federated learning approaches, experimental results demonstrate that FedDRB improves prediction accuracy by up to 12.60% and reduces the required communication cost by up to 9.78x.
引用
收藏
页数:23
相关论文
共 50 条
  • [11] Adaptive Federated Learning in Resource Constrained Edge Computing Systems
    Wang, Shiqiang
    Tuor, Tiffany
    Salonidis, Theodoros
    Leung, Kin K.
    Makaya, Christian
    He, Ting
    Chan, Kevin
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2019, 37 (06) : 1205 - 1221
  • [12] Toward efficient resource utilization at edge nodes in federated learning
    Alawadi, Sadi
    Ait-Mlouk, Addi
    Toor, Salman
    Hellander, Andreas
    PROGRESS IN ARTIFICIAL INTELLIGENCE, 2024, 13 (02) : 101 - 117
  • [13] Federated Learning for Edge Networks: Resource Optimization and Incentive Mechanism
    Khan, Latif U.
    Pandey, Shashi Raj
    Tran, Nguyen H.
    Saad, Walid
    Han, Zhu
    Nguyen, Minh N. H.
    Hong, Choong Seon
    IEEE COMMUNICATIONS MAGAZINE, 2020, 58 (10) : 88 - 93
  • [14] Joint Scheduling and Resource Allocation for Hierarchical Federated Edge Learning
    Wen, Wanli
    Chen, Zihan
    Yang, Howard H.
    Xia, Wenchao
    Quek, Tony Q. S.
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (08) : 5857 - 5872
  • [15] DYNAMIC SCHEDULING FOR FEDERATED EDGE LEARNING WITH STREAMING DATA
    Hu, Chung-Hsuan
    Chen, Zheng
    Larsson, Erik G.
    2023 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING WORKSHOPS, ICASSPW, 2023,
  • [16] Dynamic Edge Association in Hierarchical Federated Learning Networks
    Lim, Wei Yang Bryan
    Ng, Jer Shyuan
    Xiong, Zehui
    Garg, Sahil
    Zhang, Yang
    Niyato, Dusit
    Miao, Chunyan
    2021 IEEE 20TH INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS (TRUSTCOM 2021), 2021, : 1124 - 1131
  • [17] Resource-Aware Split Federated Learning for Edge Intelligence
    Arouj, Amna
    Abdelmoniem, Ahmed M.
    Alhilal, Ahmad
    You, Linlin
    Wang, Chen
    PROCEEDINGS 2024 IEEE 3RD WORKSHOP ON MACHINE LEARNING ON EDGE IN SENSOR SYSTEMS, SENSYS-ML 2024, 2024, : 15 - 20
  • [18] Resource-efficient Heterogenous Federated Continual Learning on Edge
    Yang, Zhao
    Zhang, Shengbing
    Li, Chuxi
    Wang, Haoyang
    Zhang, Meng
    2024 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION, DATE, 2024,
  • [19] Practical Attribute Reconstruction Attack Against Federated Learning
    Chen, Chen
    Lyu, Lingjuan
    Yu, Han
    Chen, Gang
    IEEE TRANSACTIONS ON BIG DATA, 2024, 10 (06) : 851 - 863
  • [20] Mitigating Heterogeneities in Federated Edge Learning with Resource-independence Aggregation
    Yang, Zhao
    Sun, Qingshuang
    2023 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION, DATE, 2023,