How to Tame Mobility in Federated Learning Over Mobile Networks?

被引:7
作者
Peng, Yan [1 ,2 ,3 ]
Tang, Xiaogang [4 ]
Zhou, Yiqing [1 ,2 ,3 ]
Hou, Yuenan [5 ]
Li, Jintao [1 ,2 ,3 ]
Qi, Yanli [1 ,2 ,3 ]
Liu, Ling [1 ,2 ,3 ]
Lin, Hai [4 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, State Key Lab Processors, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Beijing Key Lab Mobile Comp & Pervas Device, Beijing 100190, Peoples R China
[4] Space Engn Univ, Sch Aerosp Informat, Beijing 100015, Peoples R China
[5] Shanghai AI Lab, Shanghai 200232, Peoples R China
关键词
Federated learning; user mobility; resource allocation; convergence analysis; COMMUNICATION-EFFICIENT; CELLULAR NETWORKS;
D O I
10.1109/TWC.2023.3272920
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Federated learning (FL) over mobile networks has attracted intensive attention recently. User mobility is a fundamental feature of mobile networks, which leads to dynamic network topology and wireless connectivity losses. As such, user mobility is usually considered a "trouble maker" and a great challenge to FL over mobile networks. Interestingly, we found that small user mobility can positively contribute to improving FL performance. This is because the total dataset size and the data diversity that the FL can utilize are increased by user mobility. Based on this observation, we aim to tame and exploit mobility instead of treating it as a hostile "trouble maker". To this end, we first investigate how the FL performance changes with user mobility theoretically by jointly taking into account the positive and negative aspects of mobility. Specifically, a closed-form expression to quantify the impact of mobility on the FL loss is derived, which explains when negative or positive aspects of mobility dominate the FL performance. Next, a joint FL and communication optimization problem is formulated based on theoretical analyses to minimize the FL loss function by optimizing wireless resource allocation. Finally, we propose a two-step optimization algorithm to solve the formulated problem. The simulation results verify the theoretical analyses. It is also shown that the proposed method can significantly enhance learning performance considering users with high mobility. When the average velocity is larger than 150 km/h, the proposed method achieves more than 80% accuracy in the MNIST dataset, while the existing methods may fail during training.
引用
收藏
页码:9640 / 9657
页数:18
相关论文
共 42 条
  • [1] Abad MSH, 2020, INT CONF ACOUST SPEE, P8866, DOI [10.1109/icassp40776.2020.9054634, 10.1109/ICASSP40776.2020.9054634]
  • [2] Convexity, classification, and risk bounds
    Bartlett, PL
    Jordan, MI
    McAuliffe, JD
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2006, 101 (473) : 138 - 156
  • [3] Bottou L., 2007, P ADV NEUR INF PROC, P1
  • [4] Proxy Experience Replay: Federated Distillation for Distributed Reinforcement Learning
    Cha, Han
    Park, Jihong
    Kim, Hyesung
    Bennis, Mehdi
    Kim, Seong-Lyun
    [J]. IEEE INTELLIGENT SYSTEMS, 2020, 35 (04) : 94 - 101
  • [5] Chen M., 2020, PROC IEEE 21 INT WOR, P1
  • [6] A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
    Chen, Mingzhe
    Yang, Zhaohui
    Saad, Walid
    Yin, Changchuan
    Poor, H. Vincent
    Cui, Shuguang
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) : 269 - 283
  • [7] A Novel Link-to-System Mapping Technique Based on Machine Learning for 5G/IoT Wireless Networks
    Chu, Eunmi
    Yoon, Janghyuk
    Jung, Bang Chul
    [J]. SENSORS, 2019, 19 (05)
  • [8] A SURVEY ON 3GPP HETEROGENEOUS NETWORKS
    Damnjanovic, Aleksandar
    Montojo, Juan
    Wei, Yongbin
    Ji, Tingfang
    Luo, Tao
    Vajapeyam, Madhavan
    Yoo, Taesang
    Song, Osok
    Malladi, Durga
    [J]. IEEE WIRELESS COMMUNICATIONS, 2011, 18 (03) : 10 - 21
  • [9] Duong Q., 2019, Ultra-Dense Networksfor 5G and Beyond: Modelling, Analysis, and Applications
  • [10] Mobility-Aware Cluster Federated Learning in Hierarchical Wireless Networks
    Feng, Chenyuan
    Yang, Howard H.
    Hu, Deshun
    Zhao, Zhiwei
    Quek, Tony Q. S.
    Min, Geyong
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (10) : 8441 - 8458