PADP-FedMeta: A personalized and adaptive differentially private federated meta learning mechanism for AIoT

被引:16
作者
Dong, Fang [1 ]
Ge, Xinghua [1 ]
Li, Qinya [2 ]
Zhang, Jinghui [1 ]
Shen, Dian [1 ]
Liu, Siqi [1 ]
Liu, Xiao [3 ]
Li, Gang [3 ]
Wu, Fan [2 ]
Luo, Junzhou [1 ]
机构
[1] Southeast Univ, Nanjing, Peoples R China
[2] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
[3] Deakin Univ, Geelong, Australia
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Federated learning; Differential privacy; Meta learning; AIoT; COMPUTATION;
D O I
10.1016/j.sysarc.2022.102754
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Powered by edge computing, the last few years have seen a rapid growth in AIoT applications. Federated learning (FL), as a typical machine learning framework for edge intelligence, has attracted a large number of attention since it can protect user privacy. However, recent studies have shown that FL cannot fully ensure privacy. To address this, differential privacy technique is widely used in FL. Nevertheless, existing works neglect that data on devices are non-independent and identically distributed (Non-IID), which largely degrades model accuracy and convergence speed. In this paper, we propose PADP-FedMeta, a personalized and adaptive differentially private federated meta learning mechanism with a provable privacy and convergence guarantee. PADP-FedMeta mitigates the negative effect of Non-IID upon model accuracy by introducing federated meta learning, and significantly improves the convergence speed with an adaptive privacy parameter. Comprehensive experimental results show the effectiveness of our mechanism and its superior performance over the state-of-the-art differentially private FL schemes.
引用
收藏
页数:15
相关论文
共 32 条
[1]   Deep Learning with Differential Privacy [J].
Abadi, Martin ;
Chu, Andy ;
Goodfellow, Ian ;
McMahan, H. Brendan ;
Mironov, Ilya ;
Talwar, Kunal ;
Zhang, Li .
CCS'16: PROCEEDINGS OF THE 2016 ACM SIGSAC CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, 2016, :308-318
[2]  
Bagdasaryan E, 2019, ADV NEUR IN, V32
[3]   Towards Decentralized Deep Learning with Differential Privacy [J].
Cheng, Hsin-Pai ;
Yu, Patrick ;
Hu, Haojing ;
Zawad, Syed ;
Yan, Feng ;
Li, Shiyu ;
Li, Hai ;
Chen, Yiran .
CLOUD COMPUTING - CLOUD 2019, 2019, 11513 :130-145
[4]  
Dinh CT, 2020, ADV NEUR IN, V33
[5]  
Dwork C., 2016, PODS 05 P 24 ACM SIG, P128
[6]   The Algorithmic Foundations of Differential Privacy [J].
Dwork, Cynthia ;
Roth, Aaron .
FOUNDATIONS AND TRENDS IN THEORETICAL COMPUTER SCIENCE, 2013, 9 (3-4) :211-406
[7]  
Fallah A, 2020, Arxiv, DOI arXiv:2002.07948
[8]  
Geyer RC, 2017, arXiv, DOI [10.48550/arXiv.1712.07557, DOI 10.48550/ARXIV.1712.07557]
[9]   Efficient and Privacy-Enhanced Federated Learning for Industrial Artificial Intelligence [J].
Hao, Meng ;
Li, Hongwei ;
Luo, Xizhao ;
Xu, Guowen ;
Yang, Haomiao ;
Liu, Sen .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (10) :6532-6542
[10]  
Huang YT, 2021, AAAI CONF ARTIF INTE, V35, P7865