Accelerating Convergence of Federated Learning in MEC With Dynamic Community

被引:26
作者
Sun, Wen [1 ]
Zhao, Yong [1 ]
Ma, Wenqiang [1 ]
Guo, Bin [2 ]
Xu, Lexi [3 ]
Duong, Trung Q. [4 ]
机构
[1] Northwestern Polytech Univ, Dept Cybersecur, Xian 710060, Peoples R China
[2] Northwestern Polytech Univ, Dept Comp Sci, Xian 710060, Peoples R China
[3] China United Network Commun Corp, Res Inst, Beijing 100140, Peoples R China
[4] Queens Univ Belfast, Belfast BT7 1NN, North Ireland
基金
中国国家自然科学基金;
关键词
Federated learning; Training; Adaptation models; Convergence; Task analysis; Reinforcement learning; Heuristic algorithms; Deep reinforcement learning; edge intelligence; federated learning; resource allocation; COMMUNICATION;
D O I
10.1109/TMC.2023.3241770
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mobile edge computing (MEC) brings computational resources to the edge of network that triggers the paradigm shift of centralized machine learning towards federated learning. Federated learning enables edge nodes to collaboratively train a shared prediction model without sharing data. In MEC, heterogeneous edge nodes may join or leave the training phase during the federated learning process, resulting in slow convergence of dynamic communities and federated learning. In this paper, we propose a fine-grained training strategy for federated learning to accelerate its convergence rate in MEC with dynamic community. Based on multi-agent reinforcement learning, the proposed scheme enables each edge node to adaptively adjust its training strategy (aggregation timing and frequency) according to the network dynamics, while compromising with each other to improve the convergence of federated learning. To further adapt to the dynamic community in MEC, we propose a meta-learning-based scheme where new nodes can learn from other nodes and quickly perform scene migration to further accelerate the convergence of federated learning. Numerical results show that the proposed framework outperforms the benchmarks in terms of convergence speed, learning accuracy, and resource consumption.
引用
收藏
页码:1769 / 1784
页数:16
相关论文
共 29 条
  • [1] Bonawitz K. A., 2019, Proceedings of machine learning and systems, P374
  • [2] Nguyen DC, 2021, Arxiv, DOI arXiv:2104.07914
  • [3] Cazabet R, 2017, Dynamic community detectionJ
  • [4] Zero Knowledge Clustering Based Adversarial Mitigation in Heterogeneous Federated Learning
    Chen, Zheyi
    Tian, Pu
    Liao, Weixian
    Yu, Wei
    [J]. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2021, 8 (02): : 1070 - 1083
  • [5] Learning to Coordinate with Deep Reinforcement Learning in Doubles Pong Game
    Diallo, Elhadji Amadou Oury
    Sugiyama, Ayumi
    Sugawara, Toshiharu
    [J]. 2017 16TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2017, : 14 - 19
  • [6] Finn C, 2017, PR MACH LEARN RES, V70
  • [7] Gupta Jayesh K., 2017, Autonomous Agents and Multiagent Systems, AAMAS 2017: Workshops, Best Papers. Revised Selected Papers: LNAI 10642, P66, DOI 10.1007/978-3-319-71682-4_5
  • [8] Hamdi R., 2021, PROC IEEE GLOB COMMU, P1
  • [9] Jang E, 2017, Arxiv, DOI arXiv:1611.01144
  • [10] Jiang YH, 2023, Arxiv, DOI arXiv:1909.12488