An Adaptive Compression and Communication Framework for Wireless Federated Learning

被引:1
|
作者
Yang, Yang [1 ]
Dang, Shuping [2 ]
Zhang, Zhenrong [1 ]
机构
[1] Guangxi Univ, Guangxi Key Lab Multimedia Commun Network Technol, Sch Comp & Elect Informat, Nanning, Peoples R China
[2] Univ Bristol, Sch Elect Elect & Mech Engn, Bristol, England
关键词
Convergence; Training; Vectors; Computational modeling; Quantization (signal); Communication system security; Optimization; Federated learning; communication-computing trade-off; distributed machine learning; joint optimization; model compression;
D O I
10.1109/TMC.2024.3382776
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning (FL) is a distributed privacy-preserving paradigm of machine learning that enables efficient and secure model training through the collaboration of multiple clients. However, imperfect channel estimation and resource constraints of edge devices severely hinder the convergence of typical wireless FL, while the trade-off between communications and computation still lacks in-depth exploration. These factors lead to inefficient communications and hinder the full potential of FL from being unleashed. In this regard, we formulate a joint optimization problem of communications and learning in wireless networks subject to dynamic channel variations. For addressing the formulated problem, we propose an integrated adaptive $n$n-ary compression and resource management framework (ANC) that is capable of adjusting the selection of edge devices and compression schemes, and allocates the optimal resource blocks and transmit power to each participating device, which effectively improves the energy efficiency and scalability of FL in resource-constrained environments. Furthermore, an upper bound on the expected global convergence rate is derived in this paper to quantify the impacts of transmitted data volume and wireless propagation on the convergence of FL. Simulation results demonstrate that the proposed adaptive framework achieves much faster convergence while maintaining considerably low communication overhead.
引用
收藏
页码:10835 / 10854
页数:20
相关论文
共 50 条
  • [1] Analog Compression and Communication for Federated Learning over Wireless MAC
    Abdi, Afshin
    Saidutta, Yashas Malur
    Fekri, Faramarz
    PROCEEDINGS OF THE 21ST IEEE INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (IEEE SPAWC2020), 2020,
  • [2] Adaptive Batchsize Selection and Gradient Compression for Wireless Federated Learning
    Liu, Shengli
    Yu, Guanding
    Yin, Rui
    Yuan, Jiantao
    Qu, Fengzhong
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [3] SoteriaFL: A Unified Framework for Private Federated Learning with Communication Compression
    Li, Zhize
    Zhao, Haoyu
    Li, Boyue
    Chi, Yuejie
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [4] Dual Adaptive Compression for Efficient Communication in Heterogeneous Federated Learning
    Mao, Yingchi
    Wang, Zibo
    Li, Chenxin
    Zhang, Jiakai
    Xu, Shufang
    Wu, Jie
    2024 IEEE 24TH INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING, CCGRID 2024, 2024, : 236 - 244
  • [5] Secure Federated Learning over Wireless Communication Networks with Model Compression
    DING Yahao
    Mohammad SHIKH-BAHAEI
    YANG Zhaohui
    HUANG Chongwen
    YUAN Weijie
    ZTE Communications, 2023, 21 (01) : 46 - 54
  • [6] GossipFL: A Decentralized Federated Learning Framework With Sparsified and Adaptive Communication
    Tang, Zhenheng
    Shi, Shaohuai
    Li, Bo
    Chu, Xiaowen
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2023, 34 (03) : 909 - 922
  • [7] Adaptive Model Pruning for Communication and Computation Efficient Wireless Federated Learning
    Chen, Zhixiong
    Yi, Wenqiang
    Shin, Hyundong
    Nallanathan, Arumugam
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (07) : 7582 - 7598
  • [8] FedACA: An Adaptive Communication-Efficient Asynchronous Framework for Federated Learning
    Zhou, Shuang
    Huo, Yuankai
    Bao, Shunxing
    Landman, Bennett
    Gokhale, Aniruddha
    2022 IEEE INTERNATIONAL CONFERENCE ON AUTONOMIC COMPUTING AND SELF-ORGANIZING SYSTEMS (ACSOS 2022), 2022, : 71 - 80
  • [9] Federated learning with adaptive communication compression under dynamic bandwidth and unreliable networks
    Zhang, Xiongtao
    Zhu, Xiaomin
    Wang, Ji
    Yan, Hui
    Chen, Huangke
    Bao, Weidong
    INFORMATION SCIENCES, 2020, 540 : 242 - 262
  • [10] Adaptive Modulation for Wireless Federated Learning
    Xu, Xinyi
    Yu, Guanding
    Liu, Shengli
    2021 IEEE 32ND ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2021,