Hier-FUN: Hierarchical Federated Learning and Unlearning in Heterogeneous Edge Computing

被引:1
作者
Ma, Zhenguo [1 ]
Tu, Huaqing [2 ]
Zhou, Li [1 ]
Ji, Pengli [1 ]
Yan, Xiaoran [1 ]
Xu, Hongli [3 ,4 ]
Wang, Zhiyuan [3 ,4 ]
Chen, Suo [3 ,4 ]
机构
[1] Zhejiang Lab, Res Ctr Data Hub & Secur, Hangzhou 311121, Zhejiang, Peoples R China
[2] Zhejiang Lab, Res Ctr Innovat Intelligent Comp Facil, Hangzhou 311121, Zhejiang, Peoples R China
[3] Univ Sci & Technol China, Sch Comp Sci & Technol, Hefei 230027, Anhui, Peoples R China
[4] Univ Sci & Technol China, Suzhou Inst Adv Res, Suzhou 215123, Jiangsu, Peoples R China
基金
中国博士后科学基金; 美国国家科学基金会;
关键词
Data models; Performance evaluation; Servers; Computational modeling; Training; Internet of Things; Federated learning; Edge computing; Magnetic heads; Heuristic algorithms; Device heterogeneity; edge computing (EC); federated unlearning (FUN); hierarchical architectures; non-independent and identically distributed (Non-IID);
D O I
10.1109/JIOT.2024.3502666
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning (FL) has emerged as a pivotal paradigm for distributed model training in edge computing (EC), enabling cooperation among numerous Internet of Things devices while safeguarding their data privacy. Despite its successes in machine learning, concerns regarding data security and model fidelity necessitate the efficient unlearning of target device, i.e., federated unlearning (FUN). However, due to resource constraints, device heterogeneity, and non-independent and identically distributed (Non-IID) data, securely eliminating a device's impact without retraining the model from scratch presents a complex challenge. In response to these challenges, we propose a hierarchical FUN framework, called Hier-FUN. Hier-FUN organizes edge devices into K clusters, each managed by a head device responsible for aggregating local models within the cluster. To expedite both the learning and unlearning processes of Hier-FUN, we design a heuristic algorithm to determine an appropriate value for K based on devices' data distributions and available resources. In addition, Hier-FUN denies the communication between the server and cluster heads during training, which can constrain the influence sphere of target device and accelerate the unlearning process. We conduct extensive experiments using real-world datasets, and the experimental results illustrate that Hier-FUN can improve test accuracy by 3.19% during the learning phase and achieve a 6.8x speedup during unlearning compared with the baseline methods.
引用
收藏
页码:8653 / 8668
页数:16
相关论文
共 62 条
[1]  
Abad MSH, 2020, INT CONF ACOUST SPEE, P8866, DOI [10.1109/icassp40776.2020.9054634, 10.1109/ICASSP40776.2020.9054634]
[2]   Federated Learning for Healthcare: Systematic Review and Architecture Proposal [J].
Antunes, Rodolfo Stoffel ;
da Costa, Cristiano Andre ;
Kuederle, Arne ;
Yari, Imrana Abdullahi ;
Eskofier, Bjoern .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2022, 13 (04)
[3]   A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks [J].
Chen, Mingzhe ;
Yang, Zhaohui ;
Saad, Walid ;
Yin, Changchuan ;
Poor, H. Vincent ;
Cui, Shuguang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) :269-283
[4]  
Chen Suo, 2023, CNIOT '23: Proceedings of the 2023 4th International Conference on Computing, Networks and Internet of Things, P990, DOI 10.1145/3603781.3604232
[5]  
Cormen T.H., 2022, Introduction to algorithms," in
[6]   Multiagent Reinforcement Learning-Based Cooperative Multitype Task Offloading Strategy for Internet of Vehicles in B5G/6G Network [J].
Cui, Yuya ;
Li, Honghu ;
Zhang, Degan ;
Zhu, Aixi ;
Li, Yang ;
Qiang, Hao .
IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (14) :12248-12260
[7]   On-Device Indoor Positioning: A Federated Reinforcement Learning Approach With Heterogeneous Devices [J].
Dou, Fei ;
Lu, Jin ;
Zhu, Tan ;
Bi, Jinbo .
IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (03) :3909-3926
[8]  
Dulmage A.L., 1958, Canadian Journal of Mathematics, V10, P517, DOI DOI 10.4153/CJM-1958-052-0
[9]   Robust Federated Learning with Noisy and Heterogeneous Clients [J].
Fang, Xiuwen ;
Ye, Mang .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, :10062-10071
[10]   Mixed-Privacy Forgetting in Deep Networks [J].
Golatkar, Aditya ;
Achille, Alessandro ;
Ravichandran, Avinash ;
Polito, Marzia ;
Soatto, Stefano .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :792-801