Edge-assisted U-shaped split federated learning with privacy-preserving for Internet of Things

被引:1
作者
Zhang, Shiqiang [1 ]
Zhao, Zihang [1 ,2 ]
Liu, Detian [2 ]
Cao, Yang [1 ]
Tang, Hengliang [1 ]
You, Siqing [1 ]
机构
[1] Beijing Wuzi Univ, Sch Informat, Beijing 101149, Peoples R China
[2] Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
关键词
Federated learning; Split learning; Internet of Things; Differential privacy; Privacy-preserving; NETWORKS; IOT;
D O I
10.1016/j.eswa.2024.125494
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the realm of the Internet of Things (IoT), deploying deep learning models to process data generated or collected by IoT devices is a critical challenge. However, direct data transmission can cause network congestion and inefficient execution, given that IoT devices typically lack computation and communication capabilities. Centralized data processing in data centers is also no longer feasible due to concerns over data privacy and security. To address these challenges, we present an innovative Edge-assisted U-Shaped Split Federated Learning (EUSFL) framework, which harnesses the high-performance capabilities of edge servers to assist IoT devices in model training and optimization process. In this framework, we leverage Federated Learning (FL) to enable data holders to collaboratively train models without sharing their data, thereby enhancing data privacy protection by transmitting only model parameters. Additionally, inspired by Split Learning (SL), we split the neural network into three parts using U-shaped splitting for local training on IoT devices. By exploiting the greater computation capability of edge servers, our framework effectively reduces overall training time and allows IoT devices with varying capabilities to perform training tasks efficiently. Furthermore, we proposed a novel noise mechanism called LabelDP to ensure that data features and labels can securely resist reconstruction attacks, eliminating the risk of privacy leakage. Our theoretical analysis and experimental results demonstrate that EUSFL can be integrated with various aggregation algorithms, maintaining good performance across different computing capabilities of IoT devices, and significantly reducing training time and local computation overhead.
引用
收藏
页数:14
相关论文
共 50 条
[41]   Efficient Federated Learning Algorithm for Resource Allocation in Wireless IoT Networks [J].
Van-Dinh Nguyen ;
Sharma, Shree Krishna ;
Vu, Thang X. ;
Chatzinotas, Symeon ;
Ottersten, Bjorn .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (05) :3394-3409
[42]  
Vepakomma P, 2018, Arxiv, DOI arXiv:1812.00564
[43]  
Wang Jianyu, 2020, Advances in Neural Information Processing Systems, V33
[44]   CMFL: Mitigating Communication Overhead for Federated Learning [J].
Wang, Luping ;
Wang, Wei ;
Li, Bo .
2019 39TH IEEE INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2019), 2019, :954-964
[45]   Split Learning Over Wireless Networks: Parallel Design and Resource Management [J].
Wu, Wen ;
Li, Mushu ;
Qu, Kaige ;
Zhou, Conghao ;
Shen, Xuemin ;
Zhuang, Weihua ;
Li, Xu ;
Shi, Weisen .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (04) :1051-1066
[46]   A survey of federated learning for edge computing: Research problems and solutions [J].
Xia, Qi ;
Ye, Winson ;
Tao, Zeyi ;
Wu, Jindi ;
Li, Qun .
HIGH-CONFIDENCE COMPUTING, 2021, 1 (01)
[47]  
Yang L., 2020, ser. Lecture Notes in Computer Science, DOI DOI 10.1007/978-3-030-63076-816
[48]   PACTA: An IoT Data Privacy Regulation Compliance Scheme Using TEE and Blockchain [J].
Zhang, Yongxin ;
Yang, Jiacheng ;
Lei, Hong ;
Bao, Zijian ;
Lu, Ning ;
Shi, Wenbo ;
Chen, Bangdao .
IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (05) :8882-8893
[49]  
Zhao B, 2020, Arxiv, DOI arXiv:2001.02610
[50]  
Zhu LG, 2019, ADV NEUR IN, V32