Age of Information Based Client Selection for Wireless Federated Learning With Diversified Learning Capabilities

被引:0
作者
Dong, Liran [1 ,2 ,3 ]
Zhou, Yiqing [1 ,2 ,3 ]
Liu, Ling [1 ,2 ,3 ]
Qi, Yanli [1 ,2 ,3 ]
Zhang, Yu [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, State Key Lab Processors, Beijing 100190, Peoples R China
[2] Beijing Key Lab Mobile Comp & Pervas Device, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
关键词
Training; Computational modeling; Servers; Data models; Wireless communication; Mobile computing; Accuracy; Federated learning (FL); age of information (AoI); client selection; fairness scheduling; COMMUNICATION; CONVERGENCE; DEVICES; DESIGN;
D O I
10.1109/TMC.2024.3450549
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated Learning (FL) empowers wireless intelligent applications, by leveraging distributed data of edge clients for training without compromising privacy. Client selection is inevitable in FL, since clients have diversified learning capabilities arising from heterogeneous computing and communication resources. Existing methods like fair-selection and dropping-straggler are either inefficient or unfair (resulting in a less effective trained model). Therefore, we propose FedAoI, an Age-of-Information (AoI) based client selection policy. FedAoI ensures fairness by allowing all clients, including stragglers, to submit their model updates while maintaining high training efficiency by keeping round completion times short. This trade-off is achieved by minimizing Peak-AoI (PAoI), the interval between a client's consecutive participations. An optimization problem is formulated by minimizing the Expected-Weighted-Sum-of-PAoI. This NP-hard problem is addressed with a two-step sub-optimal algorithm, PriorS. It first calculates client priority in a round using Lyapunov optimization and then selects the highest-priority clients through G-FPFC (Greedy minimization of the round weighted-sum-of-PAoI with First-Priority-First-Considered). Simulation results demonstrate that, compared to fair-selection, FedAoI improves average efficiency by 83.8% and achieves an average model accuracy of 97.3% (or at the cost of averaging 2.7% degradation in model accuracy). Compared to dropping-straggler, FedAoI reduces the average model accuracy degradation from 9.5% to 2.7%.
引用
收藏
页码:14934 / 14945
页数:12
相关论文
共 50 条
  • [21] Adaptive Client Selection in Resource Constrained Federated Learning Systems: A Deep Reinforcement Learning Approach
    Zhang, Hangjia
    Xie, Zhijun
    Zarei, Roozbeh
    Wu, Tao
    Chen, Kewei
    [J]. IEEE ACCESS, 2021, 9 : 98423 - 98432
  • [22] Client Selection and Bandwidth Allocation in Wireless Federated Learning Networks: A Long-Term Perspective
    Xu, Jie
    Wang, Heqiang
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (02) : 1188 - 1200
  • [23] Knowledge Caching for Federated Learning in Wireless Cellular Networks
    Zheng, Xin-Ying
    Lee, Ming-Chun
    Hsu, Kai-Chieh
    Hong, Y. -W. Peter
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (08) : 9235 - 9250
  • [24] Multi-Armed Bandit-Based Client Scheduling for Federated Learning
    Xia, Wenchao
    Quek, Tony Q. S.
    Guo, Kun
    Wen, Wanli
    Yang, Howard H.
    Zhu, Hongbo
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (11) : 7108 - 7123
  • [25] Federated Transfer Learning With Client Selection for Intrusion Detection in Mobile Edge Computing
    Cheng, Yanyu
    Lu, Jianyuan
    Niyato, Dusit
    Lyu, Biao
    Kang, Jiawen
    Zhu, Shunmin
    [J]. IEEE COMMUNICATIONS LETTERS, 2022, 26 (03) : 552 - 556
  • [26] An Efficiency-Boosting Client Selection Scheme for Federated Learning With Fairness Guarantee
    Huang, Tiansheng
    Lin, Weiwei
    Wu, Wentai
    He, Ligang
    Li, Keqin
    Zomaya, Albert
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2021, 32 (07) : 1552 - 1564
  • [27] Federated Noisy Client Learning
    Tam, Kahou
    Li, Li
    Han, Bo
    Xu, Chengzhong
    Fu, Huazhu
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (01) : 1799 - 1812
  • [28] Reputation-Aware Federated Learning Client Selection Based on Stochastic Integer Programming
    Tan, Xavier
    Ng, Wei
    Lim, Wei
    Xiong, Zehui
    Niyato, Dusit
    Yu, Han
    [J]. IEEE TRANSACTIONS ON BIG DATA, 2024, 10 (06) : 953 - 964
  • [29] Tailored Federated Learning With Adaptive Central Acceleration on Diversified Global Models
    Zhao, Lei
    Cai, Lin
    Lu, Wu-Sheng
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [30] Federated Learning With Non-IID Data in Wireless Networks
    Zhao, Zhongyuan
    Feng, Chenyuan
    Hong, Wei
    Jiang, Jiamo
    Jia, Chao
    Quek, Tony Q. S.
    Peng, Mugen
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (03) : 1927 - 1942