Privacy-Preserving Face Recognition with Learnable Privacy Budgets in Frequency Domain

被引:26
作者
Ji, Jiazhen [1 ]
Wang, Huan [2 ]
Huang, Yuge [1 ]
Wu, Jiaxiang [1 ]
Xu, Xingkun [1 ]
Ding, Shouhong [1 ]
Zhang, ShengChuan [2 ]
Cao, Liujuan [2 ]
Ji, Rongrong [2 ]
机构
[1] Tencent, Youtu Lab, Shanghai, Peoples R China
[2] Xiamen Univ, Xiamen, Peoples R China
来源
COMPUTER VISION, ECCV 2022, PT XII | 2022年 / 13672卷
关键词
Privacy-preserving; Face recognition; Differential privacy;
D O I
10.1007/978-3-031-19775-8_28
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face recognition technology has been used in many fields due to its high recognition accuracy, including the face unlocking of mobile devices, community access control systems, and city surveillance. As the current high accuracy is guaranteed by very deep network structures, facial images often need to be transmitted to third-party servers with high computational power for inference. However, facial images visually reveal the user's identity information. In this process, both untrusted service providers and malicious users can significantly increase the risk of a personal privacy breach. Current privacy-preserving approaches to face recognition are often accompanied by many side effects, such as a significant increase in inference time or a noticeable decrease in recognition accuracy. This paper proposes a privacy-preserving face recognition method using differential privacy in the frequency domain. Due to the utilization of differential privacy, it offers a guarantee of privacy in theory. Meanwhile, the loss of accuracy is very slight. This method first converts the original image to the frequency domain and removes the direct component termed DC. Then a privacy budget allocation method can be learned based on the loss of the back-end face recognition network within the differential privacy framework. Finally, it adds the corresponding noise to the frequency domain features. Our method performs very well with several classical face recognition test sets according to the extensive experiments. Code will be available at https://github.com/Tencent/TFace/tree/master/recognition/tasks/dctdp.
引用
收藏
页码:475 / 491
页数:17
相关论文
共 38 条
[1]  
[Anonymous], 2008, WORKSHOP FACES INREA
[2]  
Bai F, 2021, Arxiv, DOI arXiv:2105.02501
[3]   MP2ML: A Mixed-Protocol Machine Learning Framework for Private Inference [J].
Boemer, Fabian ;
Cammarota, Rosario ;
Demmler, Daniel ;
Schneider, Thomas ;
Yalame, Hossein .
15TH INTERNATIONAL CONFERENCE ON AVAILABILITY, RELIABILITY AND SECURITY, ARES 2020, 2020,
[4]   A non-local algorithm for image denoising [J].
Buades, A ;
Coll, B ;
Morel, JM .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, :60-65
[5]   VGGFace2: A dataset for recognising faces across pose and age [J].
Cao, Qiong ;
Shen, Li ;
Xie, Weidi ;
Parkhi, Omkar M. ;
Zisserman, Andrew .
PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, :67-74
[6]  
Carlini N, 2021, Arxiv, DOI arXiv:2011.05315
[7]   Privacy Preserving Face Recognition Utilizing Differential Privacy [J].
Chamikara, M. A. P. ;
Bertok, P. ;
Khalil, I. ;
Liu, D. ;
Camtepe, S. .
COMPUTERS & SECURITY, 2020, 97
[8]   Obfuscation of images via differential privacy: From facial images to general images [J].
Croft, William L. ;
Sack, Jorg-Rudiger ;
Shi, Wei .
PEER-TO-PEER NETWORKING AND APPLICATIONS, 2021, 14 (03) :1705-1733
[9]   ArcFace: Additive Angular Margin Loss for Deep Face Recognition [J].
Deng, Jiankang ;
Guo, Jia ;
Xue, Niannan ;
Zafeiriou, Stefanos .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :4685-4694
[10]  
Dowlin N, 2016, PR MACH LEARN RES, V48