Mobility-Aware Cluster Federated Learning in Hierarchical Wireless Networks

被引:57
作者
Feng, Chenyuan [1 ]
Yang, Howard H. [2 ,3 ,4 ]
Hu, Deshun [5 ]
Zhao, Zhiwei [6 ]
Quek, Tony Q. S. [7 ]
Min, Geyong [8 ]
机构
[1] Shenzhen Univ, Shenzhen Key Lab Digital Creat Technol, Shenzhen 518060, Peoples R China
[2] Zhejiang Univ, Zhejiang Univ Univ Illinois Urbana Champaign Inst, Haining 314400, Peoples R China
[3] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou 310007, Peoples R China
[4] Univ Illinois, Dept Elect & Comp Engn, Champaign, IL 61820 USA
[5] Harbin Inst Technol, Dept Commun Engn, Harbin 150001, Peoples R China
[6] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 610051, Peoples R China
[7] Singapore Univ Technol & Design, Informat Syst Technol & Design, Singapore 487372, Singapore
[8] Univ Exeter, Coll Engn Math & Phys Sci, Dept Comp Sci, Exeter EX4 4QF, Devon, England
基金
新加坡国家研究基金会;
关键词
Hierarchical federated learning; user mobility; data heterogeneity; convergence analysis; OPTIMIZATION; CONVERGENCE;
D O I
10.1109/TWC.2022.3166386
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Implementing federated learning (FL) algorithms in wireless networks has garnered a wide range of attention. However, few works have considered the impact of user mobility on the learning performance. To fill this research gap, we develop a theoretical model to characterize the hierarchical federated learning (HFL) algorithm in wireless networks where the mobile users may roam across edge access points (APs), leading to incompletion of inconsistent FL training. We provide the convergence analysis of conventional HFL with user mobility. Our analysis proves that the learning performance of conventional HFL deteriorates drastically with highly-mobile users. And such a decline in the learning performance will be exacerbated with small number of participants and large data distribution divergences among users' local data. To circumvent these issues, we propose a mobility-aware cluster federated learning (MACFL) algorithm by redesigning the access mechanism, local update rule, and model aggregation scheme. We also conduct experiments to evaluate the learning performance of conventional HFL, a cluster federated learning (CFL) with simple averaging, and our proposed MACFL. The results show that our MACFL can enhance the learning performance, especially for three diffrrent cases: (i) the case of users with non-independent and identically distributed (non-IID) data, (ii) the case of users with high mobility, and (iii) the case with a small number of users.
引用
收藏
页码:8441 / 8458
页数:18
相关论文
共 37 条
  • [1] Abad MSH, 2020, INT CONF ACOUST SPEE, P8866, DOI [10.1109/ICASSP40776.2020.9054634, 10.1109/icassp40776.2020.9054634]
  • [2] Convergence of Update Aware Device Scheduling for Federated Learning at the Wireless Edge
    Amiri, Mohammad Mohammadi
    Gunduz, Deniz
    Kulkarni, Sanjeev R.
    Poor, H. Vincent
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (06) : 3643 - 3658
  • [3] Bezborodov V, 2015, Arxiv, DOI arXiv:1502.06783
  • [4] Optimization Methods for Large-Scale Machine Learning
    Bottou, Leon
    Curtis, Frank E.
    Nocedal, Jorge
    [J]. SIAM REVIEW, 2018, 60 (02) : 223 - 311
  • [5] Briggs C., 2020, IEEE IJCNN, P1, DOI DOI 10.1109/IJCNN48605.2020.9207469
  • [6] Castiglia T., MULTILEVEL LOCAL SGD
  • [7] Castiglia T, 2022, Arxiv, DOI arXiv:2007.13819
  • [8] Chen C, 2020, Arxiv, DOI arXiv:2009.10748
  • [9] Convergence Time Optimization for Federated Learning Over Wireless Networks
    Chen, Mingzhe
    Poor, H. Vincent
    Saad, Walid
    Cui, Shuguang
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (04) : 2457 - 2471
  • [10] A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
    Chen, Mingzhe
    Yang, Zhaohui
    Saad, Walid
    Yin, Changchuan
    Poor, H. Vincent
    Cui, Shuguang
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) : 269 - 283