Communication-Efficient Federated Learning With Adaptive Aggregation for Heterogeneous Client-Edge-Cloud Network

被引:9
作者
Luo, Long [1 ]
Zhang, Chi [1 ]
Yu, Hongfang [1 ]
Sun, Gang [1 ]
Luo, Shouxi [2 ]
Dustdar, Schahram [3 ]
机构
[1] Univ Elect Sci & Technol China, Chengdu 610054, Peoples R China
[2] Southwest Jiaotong Univ, Chengdu 610032, Peoples R China
[3] TU Wien, Distributed Syst Grp, A-1040 Vienna, Austria
基金
中国国家自然科学基金;
关键词
Aggregation frequency; client-edge-cloud; communication; federated learning; training efficiency;
D O I
10.1109/TSC.2024.3399649
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Client-edge-cloud Federated Learning (CEC-FL) is emerging as an increasingly popular FL paradigm, alleviating the performance limitations of conventional cloud-centric Federated Learning (FL) by incorporating edge computing. However, improving training efficiency while retaining model convergence is not easy in CEC-FL. Although controlling aggregation frequency exhibits great promise in improving efficiency by reducing communication overhead, existing works still struggle to simultaneously achieve satisfactory training efficiency and model convergence performance in heterogeneous and dynamic environments. This paper proposes FedAda, a communication-efficient CEC-FL training method that aims to enhance training performance while ensuring model convergence through adaptive aggregation frequency adjustment. To this end, we theoretically analyze the model convergence under aggregation frequency control. Based on this analysis of the relationship between model convergence and aggregation frequencies, we propose an approximation algorithm to calculate aggregation frequencies, considering convergence and aligning with heterogeneous and dynamic node capabilities, ultimately achieving superior convergence accuracy and speed. Simulation results validate the effectiveness and efficiency of FedAda, demonstrating up to 4% improvement in test accuracy, 6.8x shorter training time and 3.3x less communication overhead compared to prior solutions.
引用
收藏
页码:3241 / 3255
页数:15
相关论文
共 40 条
[1]   Reducing Communication Overhead of Federated Learning through Clustering Analysis [J].
Al-Saedi, Ahmed A. ;
Boeva, Veselka ;
Casalicchio, Emiliano .
26TH IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS (IEEE ISCC 2021), 2021,
[2]   Coalitional Federated Learning: Improving Communication and Training on Non-IID Data With Selfish Clients [J].
Arisdakessian, Sarhad ;
Wahab, Omar Abdel ;
Mourad, Azzam ;
Otrok, Hadi .
IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (04) :2462-2476
[3]  
Arora S, 2022, PR MACH LEARN RES
[4]   Walk for Learning: A Random Walk Approach for Federated Learning From Heterogeneous Data [J].
Ayache, Ghadir ;
Dassari, Venkat ;
El Rouayheb, Salim .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (04) :929-940
[5]   Knowledge-Aware Federated Active Learning with Non-IID Data [J].
Cao, Yu-Tong ;
Shi, Ye ;
Yu, Baosheng ;
Wang, Jingya ;
Tao, Dacheng .
2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, :22222-22232
[6]   Convergence Time Optimization for Federated Learning Over Wireless Networks [J].
Chen, Mingzhe ;
Poor, H. Vincent ;
Saad, Walid ;
Cui, Shuguang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (04) :2457-2471
[7]   Communication-efficient federated learning [J].
Chen, Mingzhe ;
Shlezinger, Nir ;
Poor, H. Vincent ;
Eldar, Yonina C. ;
Cui, Shuguang .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2021, 118 (17)
[8]   Communication-Efficient and Model-Heterogeneous Personalized Federated Learning via Clustered Knowledge Transfer [J].
Cho, Yae Jee ;
Wang, Jianyu ;
Chirvolu, Tarun ;
Joshi, Gauri .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2023, 17 (01) :234-247
[9]   Optimizing Training Efficiency and Cost of Hierarchical Federated Learning in Heterogeneous Mobile-Edge Cloud Computing [J].
Cui, Yangguang ;
Cao, Kun ;
Zhou, Junlong ;
Wei, Tongquan .
IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2023, 42 (05) :1518-1531
[10]   Gradient and Channel Aware Dynamic Scheduling for Over-the-Air Computation in Federated Edge Learning Systems [J].
Du, Jun ;
Jiang, Bingqing ;
Jiang, Chunxiao ;
Shi, Yuanming ;
Han, Zhu .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (04) :1035-1050