Age of Information Based Client Selection for Wireless Federated Learning With Diversified Learning Capabilities

被引:3
作者
Dong, Liran [1 ,2 ,3 ]
Zhou, Yiqing [1 ,2 ,3 ]
Liu, Ling [1 ,2 ,3 ]
Qi, Yanli [1 ,2 ,3 ]
Zhang, Yu [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, State Key Lab Processors, Beijing 100190, Peoples R China
[2] Beijing Key Lab Mobile Comp & Pervas Device, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
关键词
Training; Computational modeling; Servers; Data models; Wireless communication; Mobile computing; Accuracy; Federated learning (FL); age of information (AoI); client selection; fairness scheduling; COMMUNICATION; CONVERGENCE; DEVICES; DESIGN;
D O I
10.1109/TMC.2024.3450549
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated Learning (FL) empowers wireless intelligent applications, by leveraging distributed data of edge clients for training without compromising privacy. Client selection is inevitable in FL, since clients have diversified learning capabilities arising from heterogeneous computing and communication resources. Existing methods like fair-selection and dropping-straggler are either inefficient or unfair (resulting in a less effective trained model). Therefore, we propose FedAoI, an Age-of-Information (AoI) based client selection policy. FedAoI ensures fairness by allowing all clients, including stragglers, to submit their model updates while maintaining high training efficiency by keeping round completion times short. This trade-off is achieved by minimizing Peak-AoI (PAoI), the interval between a client's consecutive participations. An optimization problem is formulated by minimizing the Expected-Weighted-Sum-of-PAoI. This NP-hard problem is addressed with a two-step sub-optimal algorithm, PriorS. It first calculates client priority in a round using Lyapunov optimization and then selects the highest-priority clients through G-FPFC (Greedy minimization of the round weighted-sum-of-PAoI with First-Priority-First-Considered). Simulation results demonstrate that, compared to fair-selection, FedAoI improves average efficiency by 83.8% and achieves an average model accuracy of 97.3% (or at the cost of averaging 2.7% degradation in model accuracy). Compared to dropping-straggler, FedAoI reduces the average model accuracy degradation from 9.5% to 2.7%.
引用
收藏
页码:14934 / 14945
页数:12
相关论文
共 53 条
[1]  
3GPP, 2020, Tech. Rep. TR 23.700-91
[2]   FedMCCS: Multicriteria Client Selection Model for Optimal IoT Federated Learning [J].
AbdulRahman, Sawsan ;
Tout, Hanine ;
Mourad, Azzam ;
Talhi, Chamseddine .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (06) :4723-4735
[3]   Edge Intelligence: Federated Learning-Based Privacy Protection Framework for Smart Healthcare Systems [J].
Akter, Mahmuda ;
Moustafa, Nour ;
Lynar, Timothy ;
Razzak, Imran .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (12) :5805-5816
[4]   A Federated Learning-enabled Smart Street Light Monitoring Application: Benefits and Future Challenges [J].
Anand, Diya ;
Mavromatis, Ioannis ;
Carnelli, Pietro ;
Khan, Aftab .
PROCEEDINGS OF THE 2022 1ST ACM WORKSHOP ON AI EMPOWERED MOBILE AND WIRELESS SENSING, MORSE 2022, 2022, :7-12
[5]  
Bonawitz K, 2019, Arxiv, DOI arXiv:1902.01046
[6]  
Boyd S., 2004, Convex Optimization
[7]   Timely Distributed Computation With Stragglers [J].
Buyukates, Baturalp ;
Ulukus, Sennur .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (09) :5273-5282
[8]  
Caldas S., 2018, arXiv
[9]   AUCTION: Automated and Quality-Aware Client Selection Framework for Efficient Federated Learning [J].
Deng, Yongheng ;
Lyu, Feng ;
Ren, Ju ;
Wu, Huaqing ;
Zhou, Yuezhi ;
Zhang, Yaoxue ;
Shen, Xuemin .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (08) :1996-2009
[10]   Social-Feature Enabled Communications Among Devices Toward the Smart IoT Community [J].
Du, Qinghe ;
Song, Houbing ;
Zhu, Xuejie .
IEEE COMMUNICATIONS MAGAZINE, 2019, 57 (01) :130-137