An Adaptive Compression and Communication Framework for Wireless Federated Learning

被引:1
|
作者
Yang, Yang [1 ]
Dang, Shuping [2 ]
Zhang, Zhenrong [1 ]
机构
[1] Guangxi Univ, Guangxi Key Lab Multimedia Commun Network Technol, Sch Comp & Elect Informat, Nanning, Peoples R China
[2] Univ Bristol, Sch Elect Elect & Mech Engn, Bristol, England
关键词
Convergence; Training; Vectors; Computational modeling; Quantization (signal); Communication system security; Optimization; Federated learning; communication-computing trade-off; distributed machine learning; joint optimization; model compression;
D O I
10.1109/TMC.2024.3382776
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning (FL) is a distributed privacy-preserving paradigm of machine learning that enables efficient and secure model training through the collaboration of multiple clients. However, imperfect channel estimation and resource constraints of edge devices severely hinder the convergence of typical wireless FL, while the trade-off between communications and computation still lacks in-depth exploration. These factors lead to inefficient communications and hinder the full potential of FL from being unleashed. In this regard, we formulate a joint optimization problem of communications and learning in wireless networks subject to dynamic channel variations. For addressing the formulated problem, we propose an integrated adaptive $n$n-ary compression and resource management framework (ANC) that is capable of adjusting the selection of edge devices and compression schemes, and allocates the optimal resource blocks and transmit power to each participating device, which effectively improves the energy efficiency and scalability of FL in resource-constrained environments. Furthermore, an upper bound on the expected global convergence rate is derived in this paper to quantify the impacts of transmitted data volume and wireless propagation on the convergence of FL. Simulation results demonstrate that the proposed adaptive framework achieves much faster convergence while maintaining considerably low communication overhead.
引用
收藏
页码:10835 / 10854
页数:20
相关论文
共 50 条
  • [31] Asynchronous Federated Learning Over Wireless Communication Networks
    Wang, Zhongyu
    Zhang, Zhaoyang
    Tian, Yuqing
    Yang, Qianqian
    Shan, Hangguan
    Wang, Wei
    Quek, Tony Q. S.
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (09) : 6961 - 6978
  • [32] A Joint Communication and Learning Framework for Hierarchical Split Federated Learning
    Khan, Latif U.
    Guizani, Mohsen
    Al-Fuqaha, Ala
    Hong, Choong Seon
    Niyato, Dusit
    Han, Zhu
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (01) : 268 - 282
  • [33] Adaptive Transceiver Design for Wireless Hierarchical Federated Learning
    Zhou, Fangtong
    Chen, Xu
    Shan, Hangguan
    Zhou, Yong
    2023 IEEE 98TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-FALL, 2023,
  • [34] Adaptive Hierarchical Federated Learning Over Wireless Networks
    Xu, Bo
    Xia, Wenchao
    Wen, Wanli
    Liu, Pei
    Zhao, Haitao
    Zhu, Hongbo
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (02) : 2070 - 2083
  • [35] Adaptive Model Pruning for Hierarchical Wireless Federated Learning
    Liu, Xiaonan
    Wang, Shiqiang
    Deng, Yansha
    Nallanathan, Arumugam
    2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [36] Efficient Wireless Federated Learning with Adaptive Model Pruning
    Chen, Zhixiong
    Yi, Wenqiang
    Lambotharan, Sangarapillai
    Nallanathan, Arumugam
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 7592 - 7597
  • [37] Adaptive Retransmission Design for Wireless Federated Edge Learning
    XU Xinyi
    LIU Shengli
    YU Guanding
    ZTECommunications, 2023, 21 (01) : 3 - 14
  • [38] Joint Resource Management and Model Compression for Wireless Federated Learning
    Chen, Mingzhe
    Shlezinger, Nir
    Poor, H. Vincent
    Eldar, Yonina C.
    Cui, Shuguang
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [39] Stochastic gradient compression for federated learning over wireless network
    Lin, Xiaohan
    Liu, Yuan
    Chen, Fangjiong
    Huang, Yang
    Ge, Xiaohu
    CHINA COMMUNICATIONS, 2024, 21 (04) : 230 - 247
  • [40] Stochastic Gradient Compression for Federated Learning over Wireless Network
    Lin Xiaohan
    Liu Yuan
    Chen Fangjiong
    Huang Yang
    Ge Xiaohu
    China Communications, 2024, 21 (04) : 230 - 247