An Adaptive Compression and Communication Framework for Wireless Federated Learning

被引:1
|
作者
Yang, Yang [1 ]
Dang, Shuping [2 ]
Zhang, Zhenrong [1 ]
机构
[1] Guangxi Univ, Guangxi Key Lab Multimedia Commun Network Technol, Sch Comp & Elect Informat, Nanning, Peoples R China
[2] Univ Bristol, Sch Elect Elect & Mech Engn, Bristol, England
关键词
Convergence; Training; Vectors; Computational modeling; Quantization (signal); Communication system security; Optimization; Federated learning; communication-computing trade-off; distributed machine learning; joint optimization; model compression;
D O I
10.1109/TMC.2024.3382776
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning (FL) is a distributed privacy-preserving paradigm of machine learning that enables efficient and secure model training through the collaboration of multiple clients. However, imperfect channel estimation and resource constraints of edge devices severely hinder the convergence of typical wireless FL, while the trade-off between communications and computation still lacks in-depth exploration. These factors lead to inefficient communications and hinder the full potential of FL from being unleashed. In this regard, we formulate a joint optimization problem of communications and learning in wireless networks subject to dynamic channel variations. For addressing the formulated problem, we propose an integrated adaptive $n$n-ary compression and resource management framework (ANC) that is capable of adjusting the selection of edge devices and compression schemes, and allocates the optimal resource blocks and transmit power to each participating device, which effectively improves the energy efficiency and scalability of FL in resource-constrained environments. Furthermore, an upper bound on the expected global convergence rate is derived in this paper to quantify the impacts of transmitted data volume and wireless propagation on the convergence of FL. Simulation results demonstrate that the proposed adaptive framework achieves much faster convergence while maintaining considerably low communication overhead.
引用
收藏
页码:10835 / 10854
页数:20
相关论文
共 50 条
  • [21] Ternary Compression for Communication-Efficient Federated Learning
    Xu, Jinjin
    Du, Wenli
    Jin, Yaochu
    He, Wangli
    Cheng, Ran
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (03) : 1162 - 1176
  • [22] Model compression and privacy preserving framework for federated learning
    Zhu, Xi
    Wang, Junbo
    Chen, Wuhui
    Sato, Kento
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2023, 140 : 376 - 389
  • [23] Adaptive Compression in Federated Learning via Side Information
    Isik, Berivan
    Pase, Francesco
    Gunduz, Deniz
    Koyejo, Sanmi
    Weissman, Tsachy
    Zorzi, Michele
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 238, 2024, 238
  • [24] Adaptive image compression for wireless multimedia communication
    Taylor, CN
    Dey, S
    2001 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, VOLS 1-10, CONFERENCE RECORD, 2001, : 1925 - 1929
  • [25] Adaptive Federated Learning With Gradient Compression in Uplink NOMA
    Sun, Haijian
    Ma, Xiang
    Hu, Rose Qingyang
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (12) : 16325 - 16329
  • [26] ClusterGrad: Adaptive Gradient Compression by Clustering in Federated Learning
    Cui, Laizhong
    Su, Xiaoxin
    Zhou, Yipeng
    Zhang, Lei
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [27] Adaptive Federated Dropout: Improving Communication Efficiency and Generalization for Federated Learning
    Bouacida, Nader
    Hou, Jiahui
    Zang, Hui
    Liu, Xin
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (IEEE INFOCOM WKSHPS 2021), 2021,
  • [28] Asynchronous Federated Learning over Wireless Communication Networks
    Wang, Zhongyu
    Zhang, Zhaoyang
    Wang, Jue
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [29] Training Efficiency of Federated Learning: A Wireless Communication Perspective
    Yang, Shunan
    Liu, Yuan
    2020 12TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2020, : 922 - 926
  • [30] Wireless Federated Learning with Limited Communication and Differential Privacy
    Sonee, Amir
    Rini, Stefano
    Huang, Yu-Chih
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,