Age of Information Based Client Selection for Wireless Federated Learning With Diversified Learning Capabilities

被引:0
|
作者
Dong, Liran [1 ,2 ,3 ]
Zhou, Yiqing [1 ,2 ,3 ]
Liu, Ling [1 ,2 ,3 ]
Qi, Yanli [1 ,2 ,3 ]
Zhang, Yu [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, State Key Lab Processors, Beijing 100190, Peoples R China
[2] Beijing Key Lab Mobile Comp & Pervas Device, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
关键词
Training; Computational modeling; Servers; Data models; Wireless communication; Mobile computing; Accuracy; Federated learning (FL); age of information (AoI); client selection; fairness scheduling; COMMUNICATION; CONVERGENCE; DEVICES; DESIGN;
D O I
10.1109/TMC.2024.3450549
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated Learning (FL) empowers wireless intelligent applications, by leveraging distributed data of edge clients for training without compromising privacy. Client selection is inevitable in FL, since clients have diversified learning capabilities arising from heterogeneous computing and communication resources. Existing methods like fair-selection and dropping-straggler are either inefficient or unfair (resulting in a less effective trained model). Therefore, we propose FedAoI, an Age-of-Information (AoI) based client selection policy. FedAoI ensures fairness by allowing all clients, including stragglers, to submit their model updates while maintaining high training efficiency by keeping round completion times short. This trade-off is achieved by minimizing Peak-AoI (PAoI), the interval between a client's consecutive participations. An optimization problem is formulated by minimizing the Expected-Weighted-Sum-of-PAoI. This NP-hard problem is addressed with a two-step sub-optimal algorithm, PriorS. It first calculates client priority in a round using Lyapunov optimization and then selects the highest-priority clients through G-FPFC (Greedy minimization of the round weighted-sum-of-PAoI with First-Priority-First-Considered). Simulation results demonstrate that, compared to fair-selection, FedAoI improves average efficiency by 83.8% and achieves an average model accuracy of 97.3% (or at the cost of averaging 2.7% degradation in model accuracy). Compared to dropping-straggler, FedAoI reduces the average model accuracy degradation from 9.5% to 2.7%.
引用
收藏
页码:14934 / 14945
页数:12
相关论文
共 50 条
  • [1] Client Selection for Wireless Federated Learning With Data and Latency Heterogeneity
    Chen, Xiaobing
    Zhou, Xiangwei
    Zhang, Hongchao
    Sun, Mingxuan
    Vincent Poor, H.
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (19): : 32183 - 32196
  • [2] Asynchronous Wireless Federated Learning With Probabilistic Client Selection
    Yang, Jiarong
    Liu, Yuan
    Chen, Fangjiong
    Chen, Wen
    Li, Changle
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (07) : 7144 - 7158
  • [3] Jointly Optimizing Client Selection and Resource Management in Wireless Federated Learning for Internet of Things
    Yu, Liangkun
    Albelaihi, Rana
    Sun, Xiang
    Ansari, Nirwan
    Devetsikiotis, Michael
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (06) : 4385 - 4395
  • [4] Value of Information: A Comprehensive Metric for Client Selection in Federated Edge Learning
    Zou, Yifei
    Shen, Shikun
    Xiao, Mengbai
    Li, Peng
    Yu, Dongxiao
    Cheng, Xiuzhen
    IEEE TRANSACTIONS ON COMPUTERS, 2024, 73 (04) : 1152 - 1164
  • [5] Joint Client Selection and Bandwidth Allocation of Wireless Federated Learning by Deep Reinforcement Learning
    Mao, Wei
    Lu, Xingjian
    Jiang, Yuhui
    Zheng, Haikun
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2024, 17 (01) : 336 - 348
  • [6] Client Selection for Federated Bayesian Learning
    Yang, Jiarong
    Liu, Yuan
    Kassab, Rahif
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (04) : 915 - 928
  • [7] Client Selection in Hierarchical Federated Learning
    Trindade, Silvana
    da Fonseca, Nelson L. S.
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (17): : 28480 - 28495
  • [8] Client Scheduling in Wireless Federated Learning Based on Channel and Learning Qualities
    Leng, Jichao
    Lin, Zihuai
    Ding, Ming
    Wang, Peng
    Smith, David
    Vucetic, Branka
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2022, 11 (04) : 732 - 735
  • [9] Client Selection for Federated Learning With Label Noise
    Yang, Miao
    Qian, Hua
    Wang, Ximin
    Zhou, Yong
    Zhu, Honghin
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (02) : 2193 - 2197
  • [10] Active Client Selection for Clustered Federated Learning
    Huang, Honglan
    Shi, Wei
    Feng, Yanghe
    Niu, Chaoyue
    Cheng, Guangquan
    Huang, Jincai
    Liu, Zhong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (11) : 16424 - 16438