Hybrid aggregation for federated learning under blockchain framework

被引:0
作者
Li, Xinjiao [1 ]
Wu, Guowei [1 ]
Yao, Lin [2 ]
Geng, Shisong [3 ]
机构
[1] Dalian Univ Technol, Sch Software, 321 Tuqiang St, Dalian 116620, Liaoning, Peoples R China
[2] Dalian Univ Technol, DUT RU Int Sch Informat Sci & Engn, 321,Tuqiang St, Dalian, Peoples R China
[3] Chinese Acad Sci, Inst Software, 4 South 4th St, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Federated learning; Local differential privacy; Blockchain; Evaluation;
D O I
10.1016/j.comcom.2024.06.009
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning based on local differential privacy and blockchain can effectively mitigate the privacy issues of server and provide strong privacy against multiple kinds of attack. However, the actual privacy of users gradually decreases with the frequency of user updates, and noises from perturbation cause contradictions between privacy and utility. To enhance user privacy while ensuring data utility, we propose a Hybrid Aggregation mechanism based on Shuffling, Subsampling and Shapley value (HASSS) for federated learning under blockchain framework. HASSS includes two procedures, private intra-local domain aggregation and efficient inter-local domain evaluation. During the private aggregation, the local updates of users are selected and randomized to achieve gradient index privacy and gradient privacy, and then are shuffled and subsampled by shufflers to achieve identity privacy and privacy amplification. During the efficient evaluation, local servers that aggregated updates within domains broadcast and receive updates from other local servers, based on which the contribution of each local server is calculated to select nodes for global update. Two comprehensive sets are applied to evaluate the performance of HASSS. Simulations show that our scheme can enhance user privacy while ensuring data utility.
引用
收藏
页码:311 / 323
页数:13
相关论文
共 45 条
[1]   Deep Learning with Differential Privacy [J].
Abadi, Martin ;
Chu, Andy ;
Goodfellow, Ian ;
McMahan, H. Brendan ;
Mironov, Ilya ;
Talwar, Kunal ;
Zhang, Li .
CCS'16: PROCEEDINGS OF THE 2016 ACM SIGSAC CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, 2016, :308-318
[2]  
AOL, Data breach
[3]  
Balle B, 2018, ADV NEUR IN, V31
[4]  
Balle B, 2019, Arxiv, DOI arXiv:1903.02837
[5]   PROCHLO: Strong Privacy for Analytics in the Crowd [J].
Bittau, Andrea ;
Erlingsson, Ulfar ;
Maniatis, Petros ;
Mironov, Ilya ;
Raghunathan, Ananth ;
Lie, David ;
Rudominer, Mitch ;
Kode, Ushasree ;
Tinnes, Julien ;
Seefeld, Bernhard .
PROCEEDINGS OF THE TWENTY-SIXTH ACM SYMPOSIUM ON OPERATING SYSTEMS PRINCIPLES (SOSP '17), 2017, :441-459
[6]   Distributed Differential Privacy via Shuffling [J].
Cheu, Albert ;
Smith, Adam ;
Ullman, Jonathan ;
Zeber, David ;
Zhilyaev, Maxim .
ADVANCES IN CRYPTOLOGY - EUROCRYPT 2019, PT I, 2019, 11476 :375-403
[7]  
Dongkun Hou, 2021, 2021 2nd Information Communication Technologies Conference (ICTC), P302, DOI 10.1109/ICTC51749.2021.9441499
[8]  
Duchi JC, 2018, J AM STAT ASSOC, V113, P182, DOI 10.1080/01621459.2017.1389735
[9]   Local Privacy and Statistical Minimax Rates [J].
Duchi, John C. ;
Jordan, Michael I. ;
Wainwright, Martin J. .
2013 IEEE 54TH ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE (FOCS), 2013, :429-438
[10]  
Dwork C, 2004, LECT NOTES COMPUT SC, V3152, P528