Graph Federated Learning for CIoT Devices in Smart Home Applications

被引:13
作者
Rasti-Meymandi, Arash [1 ]
Sheikholeslami, Seyed Mohammad [1 ]
Abouei, Jamshid [1 ,2 ]
Plataniotis, Konstantinos N. [1 ]
机构
[1] Univ Toronto, Edward S Rogers Sr Dept Elect & Comp Engn, Toronto, ON M5S 1A1, Canada
[2] Yazd Univ, Dept Elect Engn, Yazd 89195741, Iran
基金
加拿大自然科学与工程研究理事会;
关键词
Computational modeling; Training; Smart homes; Internet of Things; Performance evaluation; Adaptation models; Smart devices; Communication efficient; Consumer Internet of Things (CIoT); federate learning (FL); graph filtering; graph signal processing (GSP); CHALLENGES;
D O I
10.1109/JIOT.2022.3228727
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article deals with the problem of statistical and system heterogeneity in a cross-silo federated learning (FL) framework where there exist a limited number of Consumer Internet of Things (CIoT) devices in a smart building. We propose a novel graph signal processing (GSP)-inspired aggregation rule based on graph filtering dubbed "G-Fedfilt." The proposed aggregator enables a structured flow of information based on the graph's topology. This behavior allows capturing the interconnection of CIoT devices and training domain-specific models. The embedded graph filter is equipped with a tunable parameter which enables a continuous tradeoff between domain-agnostic and domain-specific FL. In the case of domain-agnostic, it forces G-Fedfilt to act similar to the conventional federated averaging (FedAvg) aggregation rule. The proposed G-Fedfilt also enables an intrinsic smooth clustering based on the graph connectivity without explicitly specified which further boosts the personalization of the models in the framework. In addition, the proposed scheme enjoys a communication-efficient time scheduling to alleviate the system heterogeneity. This is accomplished by adaptively adjusting the amount of training data samples and sparsity of the models' gradients to reduce communication desynchronization and latency. Simulation results show that the proposed G-Fedfilt achieves up to 3.99% better classification accuracy than the conventional FedAvg when concerning model personalization on the statistically heterogeneous local data sets, while it is capable of yielding up to 2.41% higher accuracy than FedAvg in the case of testing the generalization of the models. Furthermore, the proposed communication optimization scheme can boost the framework's efficiency by reducing the computation, communication desynchronization, and latency up to 70.21%, 99.65%, and 44.61%, respectively, at the cost of 0.36% accuracy and under the system heterogeneity.
引用
收藏
页码:7062 / 7079
页数:18
相关论文
共 52 条
[1]  
Abad MSH, 2020, INT CONF ACOUST SPEE, P8866, DOI [10.1109/icassp40776.2020.9054634, 10.1109/ICASSP40776.2020.9054634]
[2]  
Boyd S. P., 2014, Convex Optimization
[3]   Cluster-driven Graph Federated Learning over Multiple Domains [J].
Caldarola, Debora ;
Mancini, Massimiliano ;
Galasso, Fabio ;
Ciccone, Marco ;
Rodola, Emanuele ;
Caputo, Barbara .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :2743-2752
[4]   Convergence Time Optimization for Federated Learning Over Wireless Networks [J].
Chen, Mingzhe ;
Poor, H. Vincent ;
Saad, Walid ;
Cui, Shuguang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (04) :2457-2471
[5]   Communication-efficient federated learning [J].
Chen, Mingzhe ;
Shlezinger, Nir ;
Poor, H. Vincent ;
Eldar, Yonina C. ;
Cui, Shuguang .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2021, 118 (17)
[6]   FedHealth: A Federated Transfer Learning Framework for Wearable Healthcare [J].
Chen, Yiqiang ;
Qin, Xin ;
Wang, Jindong ;
Yu, Chaohui ;
Gao, Wen .
IEEE INTELLIGENT SYSTEMS, 2020, 35 (04) :83-93
[7]   Fog and IoT: An Overview of Research Opportunities [J].
Chiang, Mung ;
Zhang, Tao .
IEEE INTERNET OF THINGS JOURNAL, 2016, 3 (06) :854-864
[8]  
Corinzia L, 2021, Arxiv, DOI arXiv:1906.06268
[9]   Software Defined Cooperative Offloading for Mobile Cloudlets [J].
Cui, Yong ;
Song, Jian ;
Ren, Kui ;
Li, Minming ;
Li, Zongpeng ;
Ren, Qingmei ;
Zhang, Yangjun .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2017, 25 (03) :1746-1760
[10]   FLEET: Online Federated Learning via Staleness Awareness and Performance Prediction [J].
Damaskinos, Georgios ;
Guerraoui, Rachid ;
Kermarrec, Anne-Marie ;
Nitu, Vlad ;
Patra, Rhicheek ;
Taiani, Francois .
PROCEEDINGS OF THE 2020 21ST INTERNATIONAL MIDDLEWARE CONFERENCE (MIDDLEWARE '20), 2020, :163-177