Simultaneous Wireless Information and Power Transfer Assisted Federated Learning via Nonorthogonal Multiple Access

被引:18
作者
Wu, Yuan [1 ,2 ,3 ]
Song, Yuxiao [1 ,2 ]
Wang, Tianshun [1 ,2 ]
Dai, Minghui [1 ,2 ]
Quek, Tony Q. S. [4 ,5 ]
机构
[1] Univ Macau, State Key Lab Internet Things Smart City, Taipa, Macau, Peoples R China
[2] Univ Macau, Dept Comp Informat Sci, Taipa, Macau, Peoples R China
[3] Zhuhai UM Sci & Technol Res Inst, Zhuhai 519031, Peoples R China
[4] Singapore Univ Technol & Design, Informat Syst Technol & Design Pillar, Singapore 487372, Singapore
[5] Natl Cheng Kung Univ, Tainan 701, Taiwan
来源
IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING | 2022年 / 6卷 / 03期
基金
中国国家自然科学基金; 新加坡国家研究基金会;
关键词
NOMA; Optimization; Wireless communication; Training; Energy consumption; Convergence; Resource management; Federated learning; simultaneous wireless information and power transfer; non-orthogonal multiple access; RESOURCE-ALLOCATION; CONVERGENCE; NETWORKS; SWIPT;
D O I
10.1109/TGCN.2022.3164574
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Federated learning (FL) has been considered as a promising approach for enabling distributed learning without sacrificing edge-devices' (EDs') data privacy. However, training machine learning (ML) model distributively is challenging to the EDs with limited energy supply. In this work, we consider that the central parameter-server (which is co-located with the cellular base station, BS) exploits simultaneous wireless information and power transfer (SWIPT) to simultaneously send the aggregated model to all EDs and also transfer energy to them. With the collected energy from the BS, each ED firstly trains its local model, and then all EDs form a non-orthogonal multiple access (NOMA) cluster for sending their local models to the central parameter-server (i.e., the BS). To minimize the total energy consumption, we formulate a joint optimization of the BS's SWIPT duration, each ED's power-splitting ratio, the EDs' NOMA uploading duration as well as the EDs' and BS's processing-rates. To address the non-convexity of the joint optimization problem, we decompose it into two subproblems, both of which are efficiently solved. We then propose an enhanced block coordinate descent (EBCD) algorithm, which iteratively solves the two subproblems in sequence and exploits the idea of simulated annealing to avoid being trapped by some local optimum, to approach to the optimal solution of the original joint optimization problem. By using our EBCD-Algorithm, we further investigate how to properly select the EDs to participate in the FL process, with the objective of minimizing all participants' total energy consumption. A cross-entropy based algorithm, which exploits our EBCD-Algorithm as a subroutine, is proposed to determine the optimal ED-selection. Numerical results are provided to validate our proposed algorithms and demonstrate the performance advantage of the proposed SWIPT assisted FL via NOMA in comparison with some conventional FL schemes.
引用
收藏
页码:1846 / 1861
页数:16
相关论文
共 49 条
[1]  
[Anonymous], LINGO MODELING LANGU
[2]   SIMULATED ANNEALING [J].
BERTSIMAS, D ;
TSITSIKLIS, J .
STATISTICAL SCIENCE, 1993, 8 (01) :10-15
[3]   WIRELESS POWERED COMMUNICATION NETWORKS: AN OVERVIEW [J].
Bi, Suzhi ;
Zeng, Yong ;
Zhang, Rui .
IEEE WIRELESS COMMUNICATIONS, 2016, 23 (02) :10-18
[4]   FedGraph: Federated Graph Learning With Intelligent Sampling [J].
Chen, Fahao ;
Li, Peng ;
Miyazaki, Toshiaki ;
Wu, Celimuge .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (08) :1775-1786
[5]   Distributed Learning in Wireless Networks: Recent Progress and Future Challenges [J].
Chen, Mingzhe ;
Gunduz, Deniz ;
Huang, Kaibin ;
Saad, Walid ;
Bennis, Mehdi ;
Feljan, Aneta Vulgarakis ;
Poor, H. Vincent .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (12) :3579-3605
[6]   A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks [J].
Chen, Mingzhe ;
Yang, Zhaohui ;
Saad, Walid ;
Yin, Changchuan ;
Poor, H. Vincent ;
Cui, Shuguang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) :269-283
[7]   COMPUTATION OFFLOADING IN BEYOND 5G NETWORKS: A DISTRIBUTED LEARNING FRAMEWORK AND APPLICATIONS [J].
Chen, Xianfu ;
Wu, Celimuge ;
Liu, Zhi ;
Zhang, Ning ;
Ji, Yusheng .
IEEE WIRELESS COMMUNICATIONS, 2021, 28 (02) :56-62
[8]  
da Silva JMBD, 2021, Arxiv, DOI arXiv:2104.12749
[9]   ARTIFICIAL INTELLIGENCE EMPOWERED EDGE COMPUTING AND CACHING FOR INTERNET OF VEHICLES [J].
Dai, Yueyue ;
Xu, Du ;
Maharjan, Sabita ;
Qiao, Guanhua ;
Zhang, Yan .
IEEE WIRELESS COMMUNICATIONS, 2019, 26 (03) :12-18
[10]   A tutorial on the cross-entropy method [J].
De Boer, PT ;
Kroese, DP ;
Mannor, S ;
Rubinstein, RY .
ANNALS OF OPERATIONS RESEARCH, 2005, 134 (01) :19-67