ESVFL: Efficient and secure verifiable federated learning with privacy-preserving

被引:10
作者
Cai, Jiewang [1 ]
Shen, Wenting [1 ]
Qin, Jing [2 ]
机构
[1] Qingdao Univ, Coll Comp Sci & Technol, Qingdao 266071, Peoples R China
[2] Shandong Univ, Sch Math, Jinan 250100, Peoples R China
基金
中国国家自然科学基金;
关键词
Privacy-preserving; Verifiable; Federated learning; Data security;
D O I
10.1016/j.inffus.2024.102420
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Federated learning has been widely applied as a distributed machine learning method in various fields, allowing a global model to be trained by sharing local gradients instead of raw data. However, direct sharing of local gradients still carries the risk of privacy data leakage, and the malicious server might falsify aggregated result to disrupt model updates. To address these issues, a lot of privacy-preserving and verifiable federated learning schemes have been proposed. However, existing schemes suffer from significant computation overhead in either encryption or verification. In this paper, we present ESVFL, an efficient and secure verifiable federated learning scheme with privacy-preserving. This scheme can simultaneously achieve low computation overhead for encryption and verification on the user side. We design an efficient privacy-preserving method to encrypt the users' local gradients. Using this method, the computation and communication overheads of encryption on the user side is independent of the number of users. Users can efficiently verify the correctness of aggregated results returned by the cloud servers using cross-verification. During the verification process, there is no interaction among users and no additional computation is required. Furthermore, we also construct an efficient method to address the issue of user dropout. When some users drop out, online users do not incur any additional computation and communication overheads, while guaranteeing the correctness of the aggregated result of online users' encrypted gradients. The security analysis and the performance evaluation demonstrate that ESVFL is secure and can achieve efficient encryption and verification.
引用
收藏
页数:17
相关论文
共 57 条
[1]   Deep Learning with Differential Privacy [J].
Abadi, Martin ;
Chu, Andy ;
Goodfellow, Ian ;
McMahan, H. Brendan ;
Mironov, Ilya ;
Talwar, Kunal ;
Zhang, Li .
CCS'16: PROCEEDINGS OF THE 2016 ACM SIGSAC CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, 2016, :308-318
[2]   QUOTIENT: Two-Party Secure Neural Network Training and Prediction [J].
Agrawal, Nitin ;
Shamsabadi, Ali Shahin ;
Kusner, Matt J. ;
Gascon, Adria .
PROCEEDINGS OF THE 2019 ACM SIGSAC CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY (CCS'19), 2019, :1231-1247
[3]   A secure and privacy preserved infrastructure for VANETs based on federated learning with local differential privacy [J].
Batool, Hajira ;
Anjum, Adeel ;
Khan, Abid ;
Izzo, Stefano ;
Mazzocca, Carlo ;
Jeon, Gwanggil .
INFORMATION SCIENCES, 2024, 652
[4]  
Bonawitz K., 2016, arXiv
[5]  
Bonawitz K. A., 2019, Proceedings of machine learning and systems, P374
[6]   Practical Secure Aggregation for Privacy-Preserving Machine Learning [J].
Bonawitz, Keith ;
Ivanov, Vladimir ;
Kreuter, Ben ;
Marcedone, Antonio ;
McMahan, H. Brendan ;
Patel, Sarvar ;
Ramage, Daniel ;
Segal, Aaron ;
Seth, Karn .
CCS'17: PROCEEDINGS OF THE 2017 ACM SIGSAC CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, 2017, :1175-1191
[7]  
Corrigan-Gibbs H, 2017, PROCEEDINGS OF NSDI '17: 14TH USENIX SYMPOSIUM ON NETWORKED SYSTEMS DESIGN AND IMPLEMENTATION, P259
[8]   Efficient Verifiable Protocol for Privacy-Preserving Aggregation in Federated Learning [J].
Eltaras, Tamer ;
Sabry, Farida ;
Labda, Wadha ;
Alzoubi, Khawla ;
Malluhi, Qutaibah .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2023, 18 :2977-2990
[9]   SAFELearn: Secure Aggregation for private FEderated Learning [J].
Fereidooni, Hossein ;
Marchal, Samuel ;
Miettinen, Markus ;
Mirhoseini, Azalia ;
Moellering, Helen ;
Thien Duc Nguyen ;
Rieger, Phillip ;
Sadeghi, Ahmad-Reza ;
Schneider, Thomas ;
Yalame, Hossein ;
Zeitouni, Shaza .
2021 IEEE SYMPOSIUM ON SECURITY AND PRIVACY WORKSHOPS (SPW 2021), 2021, :56-62
[10]   VFL: A Verifiable Federated Learning With Privacy-Preserving for Big Data in Industrial IoT [J].
Fu, Anmin ;
Zhang, Xianglong ;
Xiong, Naixue ;
Gao, Yansong ;
Wang, Huaqun ;
Zhang, Jing .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (05) :3316-3326