Decentralized Aggregation for Energy-Efficient Federated Learning via D2D Communications

被引:19
作者
Al-Abiad, Mohammed S. [1 ]
Obeed, Mohanad [2 ]
Hossain, Md. Jahangir [3 ]
Chaaban, Anas [3 ]
机构
[1] Univ Toronto, Dept Elect & Comp Engn, Toronto, ON M5S, Canada
[2] Carleton Univ, Dept Syst & Comp Engn, Ottawa, ON K1S 5B6, Canada
[3] Univ British Columbia, Dept Engn, Kelowna, BC V1V 1V7, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Device-to-device (D2D) communications; decentralized federated learning; energy consumption; WIRELESS NETWORKS; DESIGN;
D O I
10.1109/TCOMM.2023.3253718
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Federated learning (FL) has emerged as a distributed machine learning (ML) technique to train models without sharing users' private data. In this paper, we introduce a decentralized FL scheme that is called federated learning empowered overlapped clustering for decentralized aggregation (FL-EOCD). The introduced FL-EOCD leverages device-to-device (D2D) communications and overlapped clustering to enable decentralized aggregation, where a cluster is defined as a coverage zone of a typical device. The devices located on the overlapped clusters are called bridge devices (BDs). In the proposed FL-EOCD scheme, a clustering topology is envisioned where clusters are connected through BDs, so as the aggregated models of each cluster is disseminated to the other clusters in a decentralized manner without the need for a global aggregator or an additional hop of transmission. To evaluate our proposed FL-EOCD scheme as opposed to baseline FL schemes, we consider minimizing the overall energy-consumption of devices while maintaining the convergence rate of FL subject to its time constraint. To this end, a joint optimization problem, considering scheduling the local devices/BDs to the CHs and computation frequency allocation, is formulated, where an iterative solution to this joint problem is devised. Extensive simulations are conducted to verify the effectiveness of the proposed FL-EOCD algorithm over FL conventional schemes in terms of energy consumption, latency, and convergence rate.
引用
收藏
页码:3333 / 3351
页数:19
相关论文
共 38 条
[21]   Client-Edge-Cloud Hierarchical Federated Learning [J].
Liu, Lumin ;
Chang, Jun ;
Song, S. H. ;
Letaief, Khaled B. .
ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
[22]   Deep Learning for Intelligent Wireless Networks: A Comprehensive Survey [J].
Mao, Qian ;
Hu, Fei ;
Hao, Qi .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2018, 20 (04) :2595-2621
[23]   Partial Synchronization to Accelerate Federated Learning Over Relay-Assisted Edge Networks [J].
Qu, Zhihao ;
Guo, Song ;
Wang, Haozhao ;
Ye, Baoliu ;
Wang, Yi ;
Zomaya, Albert Y. ;
Tang, Bin .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (12) :4502-4516
[24]   Machine Learning Meets Computation and Communication Control in Evolving Edge and Cloud: Challenges and Future Perspective [J].
Rodrigues, Tiago Koketsu ;
Suto, Katsuya ;
Nishiyama, Hiroki ;
Liu, Jiajia ;
Kato, Nei .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2020, 22 (01) :38-67
[25]   Federated Learning With Cooperating Devices: A Consensus Approach for Massive IoT Networks [J].
Savazzi, Stefano ;
Nicoli, Monica ;
Rampa, Vittorio .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (05) :4641-4654
[26]  
Sun Y., 2021, ARXIV, DOI DOI arXiv:2112.10313.v1
[27]  
Sun YC, 2024, Arxiv, DOI arXiv:2104.12678
[28]  
Tran NH, 2019, IEEE INFOCOM SER, P1387, DOI [10.1109/INFOCOM.2019.8737464, 10.1109/infocom.2019.8737464]
[29]  
Tu YW, 2020, IEEE INFOCOM SER, P2509, DOI [10.1109/infocom41043.2020.9155372, 10.1109/INFOCOM41043.2020.9155372]
[30]   Adaptive Federated Learning in Resource Constrained Edge Computing Systems [J].
Wang, Shiqiang ;
Tuor, Tiffany ;
Salonidis, Theodoros ;
Leung, Kin K. ;
Makaya, Christian ;
He, Ting ;
Chan, Kevin .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2019, 37 (06) :1205-1221