Dynamic Logical Resource Reconstruction against Straggler Problem in Edge Federated Learning

被引:0
|
作者
Li, Kaiju [1 ]
Wang, Ha [2 ,3 ]
Mu, Xuejia [2 ,3 ]
Chen, Xian [4 ]
Shin, Hyoseop [5 ]
机构
[1] Guizhou Univ Finance & Econ, Sch Informat, Guiyang, Guizhou, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Coll Comp Sci & Technol, Chongqing, Peoples R China
[3] Minist Culture & Tourism, Key Lab Tourism Multisource Data Percept & Decis, Chongqing, Peoples R China
[4] Konkuk Univ, Data Sci Lab, Seoul, South Korea
[5] Konkuk Univ, Div Comp Sci & Engn, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Edge Computing; Federated Learning; Straggler Effect; Communication Efficiency; Resource Balance;
D O I
10.22967/HCIS.2024.14.025
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning enables edge distributed devices to learn a shared global model without violating privacy concerns. However, due to the heterogeneity in data or resources across devices, the straggler issue has become a key bottleneck for effective federated learning. As aggregation methods favor faster devices, these methods may introduce biases and severely degrade model accuracy. To solve these challenges, we propose FedDRB, a unique federated learning communication framework via dynamic resource balancing, including a dynamic logical cluster construction (DLCC) algorithm and a weighted intra-cluster collaborative (WICC) aggregation algorithm. To shorten total model training time, DLCC divides all edge devices into several logical clusters and constructs a tiered structure. In addition, WICC requires faster devices to assist the training of slower devices and assigns a relatively higher weight to slower devices during the aggregation stage, hence accelerating the intra-cluster convergence speed and ensuring training model accuracy. Compared with stateof-the-art federated learning approaches, experimental results demonstrate that FedDRB improves prediction accuracy by up to 12.60% and reduces the required communication cost by up to 9.78x.
引用
收藏
页数:23
相关论文
共 50 条
  • [31] Resource Management and Fairness for Federated Learning over Wireless Edge Networks
    Balakrishnan, Ravikumar
    Akdeniz, Mustafa
    Dhakal, Sagar
    Himayat, Nageen
    PROCEEDINGS OF THE 21ST IEEE INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (IEEE SPAWC2020), 2020,
  • [32] An Effective Approach for Resource-Constrained Edge Devices in Federated Learning
    Wen, Jun
    Li, Xiusheng
    Chen, Yupeng
    Li, Xiaoli
    Mao, Hang
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2024, 2024
  • [33] Dynamic Data Sample Selection and Scheduling in Edge Federated Learning
    Serhani, Mohamed Adel
    Abreha, Haftay Gebreslasie
    Tariq, Asadullah
    Hayajneh, Mohammad
    Xu, Yang
    Hayawi, Kadhim
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2023, 4 : 2133 - 2149
  • [34] Privacy-Enhanced Decentralized Federated Learning at Dynamic Edge
    Chen, Shuzhen
    Wang, Yangyang
    Yu, Dongxiao
    Ren, Ju
    Xu, Congan
    Zheng, Yanwei
    IEEE TRANSACTIONS ON COMPUTERS, 2023, 72 (08) : 2165 - 2180
  • [35] Resource Constrained Vehicular Edge Federated Learning With Highly Mobile Connected Vehicles
    Pervej, Md Ferdous
    Jin, Richeng
    Dai, Huaiyu
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (06) : 1825 - 1844
  • [36] Resource-Constrained Federated Edge Learning With Heterogeneous Data: Formulation and Analysis
    Liu, Yi
    Zhu, Yuanshao
    Yu, James J. Q.
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (05): : 3166 - 3178
  • [37] Resource Optimization for Blockchain-Based Federated Learning in Mobile Edge Computing
    Wang, Zhilin
    Hu, Qin
    Xiong, Zehui
    Liu, Yuan
    Niyato, Dusit
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (09): : 15166 - 15178
  • [38] Resource Management and Model Personalization for Federated Learning over Wireless Edge Networks
    Balakrishnan, Ravikumar
    Akdeniz, Mustafa
    Dhakal, Sagar
    Anand, Arjun
    Zeira, Ariela
    Himayat, Nageen
    JOURNAL OF SENSOR AND ACTUATOR NETWORKS, 2021, 10 (01)
  • [39] Joint Resource Optimization for Federated Edge Learning With Integrated Sensing, Communication, and Computation
    Liang, Yipeng
    Chen, Qimei
    Jiang, Hao
    IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (05): : 5274 - 5288
  • [40] Resource Allocation in IoT Edge Computing via Concurrent Federated Reinforcement Learning
    Tianqing Zhu
    Zhou, Wei
    Ye, Dayong
    Cheng, Zishuo
    Li, Jin
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (02) : 1414 - 1426