CE-Fed: Communication efficient multi-party computation enabled federated learning

被引:16
作者
Kanagavelu, Renuga [1 ]
Wei, Qingsong [1 ]
Li, Zengxiang [2 ]
Zhang, Haibin [1 ]
Samsudin, Juniarto [1 ]
Yang, Yechao [1 ]
Goh, Rick Siow Mong [1 ]
Wang, Shangguang [3 ]
机构
[1] ASTAR, Inst High Performance Comp, Singapore, Singapore
[2] ENN Grp, Digital Res Inst, Langfang, Peoples R China
[3] Beijing Univ Posts & Telecommun, Sch Comp, Beijing, Peoples R China
关键词
Federated learning; Edge computing; Multi -party computation; Committee selection;
D O I
10.1016/j.array.2022.100207
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Federated learning (FL) allows a number of parties collectively train models without revealing private datasets. There is a possibility of extracting personal or confidential data from the shared models even-though sharing of raw data is prevented by federated learning. Secure Multi Party Computation (MPC) is leveraged to aggregate the locally-trained models in a privacy preserving manner. However, it results in high communication cost and poor scalability in a decentralized environment. We design a novel communication-efficient MPC enabled federated learning called CE-Fed. In particular, the proposed CE-Fed is a hierarchical mechanism which forms model aggregation committee with a small number of members and aggregates the global model only among committee members, instead of all participants. We develop a prototype and demonstrate the effectiveness of our mechanism with different datasets. Our proposed CE-Fed achieves high accuracy, communication efficiency and scalability without compromising privacy.
引用
收藏
页数:11
相关论文
共 44 条
[1]  
Aguilera M.K., 2001, Distributed Computing, P108
[2]  
Aguilera M.K., 2004, Proceedings of the 23rd Annual ACM Symposium on Principles of Distributed Computing, P328, DOI DOI 10.1145/1011767.1011816
[3]  
[Anonymous], 2020, CrypTen documentation
[4]  
[Anonymous], 2020, OpenMined/PySyft-A library for encrypted, privacy preserving deep learning
[5]  
[Anonymous], 2020, Tensor flow federated.
[6]  
[Anonymous], 2020, Webank FATE (Federated AI Technology enabler)
[7]  
[Anonymous], 2020, Softwareguard-extensions
[8]   Practical Secure Aggregation for Privacy-Preserving Machine Learning [J].
Bonawitz, Keith ;
Ivanov, Vladimir ;
Kreuter, Ben ;
Marcedone, Antonio ;
McMahan, H. Brendan ;
Patel, Sarvar ;
Ramage, Daniel ;
Segal, Aaron ;
Seth, Karn .
CCS'17: PROCEEDINGS OF THE 2017 ACM SIGSAC CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, 2017, :1175-1191
[9]   Faster Packed Homomorphic Operations and Efficient Circuit Bootstrapping for TFHE [J].
Chillotti, Ilaria ;
Gama, Nicolas ;
Georgieva, Mariya ;
Izabachene, Malika .
ADVANCES IN CRYPTOLOGY - ASIACRYPT 2017, PT I, 2017, 10624 :377-408
[10]   Secure Multiparty Computation and Trusted Hardware: Examining Adoption Challenges and Opportunities [J].
Choi, Joseph I. ;
Butler, Kevin R. B. .
SECURITY AND COMMUNICATION NETWORKS, 2019, 2019