Joint Age-Based Client Selection and Resource Allocation for Communication-Efficient Federated Learning Over NOMA Networks

被引:14
作者
Wu, Bibo [1 ]
Fang, Fang [1 ,2 ]
Wang, Xianbin [1 ]
机构
[1] Western Univ, Dept Elect & Comp Engn, London, ON N6A 5B9, Canada
[2] Western Univ, Dept Comp Sci, London, ON N6A 3K7, Canada
关键词
Resource management; NOMA; Convergence; Servers; Minimization; Training; Federated learning; Age of update; artificial neural network; client selection; federated learning; resource allocation; NONORTHOGONAL MULTIPLE-ACCESS; INFORMATION; OPTIMIZATION; CHALLENGES;
D O I
10.1109/TCOMM.2023.3317300
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In federated learning (FL), distributed clients can collaboratively train a shared global model while retaining their own training data locally. Nevertheless, the performance of FL is often limited by the slow convergence because of poor communications links when FL is deployed over wireless networks. Due to the scarceness of radio resources, it is crucial to select appropriate clients and allocate communication resource accurately for enhancing FL performance. To address these challenges, in this paper, a joint optimization problem of client selection and resource allocation is formulated, aiming to minimize the total time consumption of each round in FL over a non-orthogonal multiple access (NOMA) enabled wireless network. Specifically, considering the staleness of local FL models, we propose an age of update (AoU) based novel client selection scheme. Subsequently, the closed-form expressions for resource allocation are derived by monotonicity analysis and dual decomposition method. In addition, a server-side artificial neural network (ANN) is proposed to predict the FL models of clients who are not selected at each round to further improve FL performance. Finally, extensive simulation results demonstrate the superior performance of the proposed schemes over FL performance, average AoU and total time consumption.
引用
收藏
页码:179 / 192
页数:14
相关论文
共 44 条
[1]   Wireless Federated Learning (WFL) for 6G Networks-Part I: Research Challenges and Future Trends [J].
Bouzinis, Pavlos S. ;
Diamantoulakis, Panagiotis D. ;
Karagiannidis, George K. .
IEEE COMMUNICATIONS LETTERS, 2022, 26 (01) :3-7
[2]  
Boyd S., 2009, Convex Optimization
[3]   Matching-Theory-Based Low-Latency Scheme for Multitask Federated Learning in MEC Networks [J].
Chen, Dawei ;
Hong, Choong Seon ;
Wang, Li ;
Zha, Yiyong ;
Zhang, Yunfei ;
Liu, Xin ;
Han, Zhu .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (14) :11415-11426
[4]   Distributed Learning in Wireless Networks: Recent Progress and Future Challenges [J].
Chen, Mingzhe ;
Gunduz, Deniz ;
Huang, Kaibin ;
Saad, Walid ;
Bennis, Mehdi ;
Feljan, Aneta Vulgarakis ;
Poor, H. Vincent .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (12) :3579-3605
[5]   Convergence Time Optimization for Federated Learning Over Wireless Networks [J].
Chen, Mingzhe ;
Poor, H. Vincent ;
Saad, Walid ;
Cui, Shuguang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (04) :2457-2471
[6]   A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks [J].
Chen, Mingzhe ;
Yang, Zhaohui ;
Saad, Walid ;
Yin, Changchuan ;
Poor, H. Vincent ;
Cui, Shuguang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) :269-283
[7]   Service Delay Minimization for Federated Learning Over Mobile Devices [J].
Chen, Rui ;
Shi, Dian ;
Qin, Xiaoqi ;
Liu, Dongjie ;
Pan, Miao ;
Cui, Shuguang .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (04) :990-1006
[8]  
Dai W, 2018, Arxiv, DOI arXiv:1810.03264
[9]  
Ding ZG, 2023, Arxiv, DOI arXiv:2211.13773
[10]   A Survey on Non-Orthogonal Multiple Access for 5G Networks: Research Challenges and Future Trends [J].
Ding, Zhiguo ;
Lei, Xianfu ;
Karagiannidis, George K. ;
Schober, Robert ;
Yuan, Jinhong ;
Bhargava, Vijay K. .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2017, 35 (10) :2181-2195