Decentralized Aggregation for Energy-Efficient Federated Learning via D2D Communications

被引:19
作者
Al-Abiad, Mohammed S. [1 ]
Obeed, Mohanad [2 ]
Hossain, Md. Jahangir [3 ]
Chaaban, Anas [3 ]
机构
[1] Univ Toronto, Dept Elect & Comp Engn, Toronto, ON M5S, Canada
[2] Carleton Univ, Dept Syst & Comp Engn, Ottawa, ON K1S 5B6, Canada
[3] Univ British Columbia, Dept Engn, Kelowna, BC V1V 1V7, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Device-to-device (D2D) communications; decentralized federated learning; energy consumption; WIRELESS NETWORKS; DESIGN;
D O I
10.1109/TCOMM.2023.3253718
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Federated learning (FL) has emerged as a distributed machine learning (ML) technique to train models without sharing users' private data. In this paper, we introduce a decentralized FL scheme that is called federated learning empowered overlapped clustering for decentralized aggregation (FL-EOCD). The introduced FL-EOCD leverages device-to-device (D2D) communications and overlapped clustering to enable decentralized aggregation, where a cluster is defined as a coverage zone of a typical device. The devices located on the overlapped clusters are called bridge devices (BDs). In the proposed FL-EOCD scheme, a clustering topology is envisioned where clusters are connected through BDs, so as the aggregated models of each cluster is disseminated to the other clusters in a decentralized manner without the need for a global aggregator or an additional hop of transmission. To evaluate our proposed FL-EOCD scheme as opposed to baseline FL schemes, we consider minimizing the overall energy-consumption of devices while maintaining the convergence rate of FL subject to its time constraint. To this end, a joint optimization problem, considering scheduling the local devices/BDs to the CHs and computation frequency allocation, is formulated, where an iterative solution to this joint problem is devised. Extensive simulations are conducted to verify the effectiveness of the proposed FL-EOCD algorithm over FL conventional schemes in terms of energy consumption, latency, and convergence rate.
引用
收藏
页码:3333 / 3351
页数:19
相关论文
共 38 条
[1]   A Survey on Federated Learning: The Journey From Centralized to Distributed On-Site Learning and Beyond [J].
AbdulRahman, Sawsan ;
Tout, Hanine ;
Ould-Slimane, Hakima ;
Mourad, Azzam ;
Talhi, Chamseddine ;
Guizani, Mohsen .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (07) :5476-5497
[2]   Energy-Efficient Resource Allocation for Federated Learning in NOMA-Enabled and Relay-Assisted Internet of Things Networks [J].
Al-Abiad, Mohammed S. ;
Hassan, Md. Zoheb ;
Hossain, Md. Jahangir .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (24) :24736-24753
[3]   A Joint Reinforcement-Learning Enabled Caching and Cross-Layer Network Code in F-RAN With D2D Communications [J].
Al-Abiad, Mohammed S. ;
Hassan, Md Zoheb ;
Hossain, Md Jahangir .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2022, 70 (07) :4400-4416
[4]   Completion Time Minimization in Fog-RANs Using D2D Communications and Rate-Aware Network Coding [J].
Al-Abiad, Mohammed S. ;
Hossain, Md. Jahangir .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (06) :3831-3846
[5]   Throughput Maximization in Cloud-Radio Access Networks Using Cross-Layer Network Coding [J].
Al-Abiad, Mohammed S. ;
Douik, Ahmed ;
Sorour, Sameh ;
Hossain, Md Jahangir .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (02) :696-711
[6]   Cross-Layer Cloud Offloading With Quality of Service Guarantees in Fog-RANs [J].
Al-Abiad, Mohammed S. ;
Hossain, Md. Jahangir ;
Sorour, Sameh .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2019, 67 (12) :8435-8449
[7]   A Survey on Device-to-Device Communication in Cellular Networks [J].
Asadi, Arash ;
Wang, Qing ;
Mancuso, Vincenzo .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2014, 16 (04) :1801-1819
[8]   Processor design for portable systems [J].
Burd, TD ;
Brodersen, RW .
JOURNAL OF VLSI SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 1996, 13 (2-3) :203-221
[9]   LOW-POWER CMOS DIGITAL DESIGN [J].
CHANDRAKASAN, AP ;
SHENG, S ;
BRODERSEN, RW .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 1992, 27 (04) :473-484
[10]   Distributed Learning in Wireless Networks: Recent Progress and Future Challenges [J].
Chen, Mingzhe ;
Gunduz, Deniz ;
Huang, Kaibin ;
Saad, Walid ;
Bennis, Mehdi ;
Feljan, Aneta Vulgarakis ;
Poor, H. Vincent .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (12) :3579-3605