Synthetic data for face recognition: Current state and future prospects

被引:65
作者
Boutros, Fadi [1 ]
Struc, Vitomir [3 ]
Fierrez, Julian [4 ]
Damer, Naser [1 ,2 ]
机构
[1] Fraunhofer IGD, Fraunhoferstr 5, D-64283 Darmstadt, Hessia, Germany
[2] Tech Univ Darmstadt, Karolinenpl 5, D-64289 Darmstadt, Hessia, Germany
[3] Univ Ljubljana, Fac Elect Engn, Trzaska Cesta 25, Ljubljana 1000, Slovenia
[4] Univ Autonoma Madrid, Sch Engn, Madrid 28049, Spain
关键词
Face recognition; Synthetic data; Biometrics; MARGIN LOSS;
D O I
10.1016/j.imavis.2023.104688
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Over the past years, deep learning capabilities and the availability of large-scale training datasets advanced rapidly, leading to breakthroughs in face recognition accuracy. However, these technologies are foreseen to face a major challenge in the next years due to the legal and ethical concerns about using authentic biometric data in AI model training and evaluation along with increasingly utilizing data-hungry state-of-the-art deep learning models. With the recent advances in deep generative models and their success in generating realistic and high-resolution synthetic image data, privacy-friendly synthetic data has been recently proposed as an alternative to privacy-sensitive authentic data to overcome the challenges of using authentic data in face recognition development. This work aims at providing a clear and structured picture of the use-cases taxonomy of synthetic face data in face recognition along with the recent emerging advances of face recognition models developed on the bases of synthetic data. We also discuss the challenges facing the use of synthetic data in face recognition development and several future prospects of synthetic data in the domain of face recognition.(C) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:9
相关论文
共 59 条
[1]  
[Anonymous], 2021, ISO/IEC JTC1 SC37 Biometrics
[2]  
[Anonymous], 2018, 208892018 ISOIEC JTC
[3]  
[Anonymous], 2015, P BRIT MACH VIS C, DOI [DOI 10.5244/C.29.41, 10.5244/C.29.41]
[4]   DigiFace-1M: 1 Million Digital Face Images for Face Recognition [J].
Bae, Gwangbin ;
de La Gorce, Martin ;
Baltrusaitis, Tadas ;
Hewitt, Charlie ;
Chen, Dong ;
Valentin, Julien ;
Cipolla, Roberto ;
Shen, Jingjing .
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, :3515-3524
[5]  
Bansal Ankan, 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB), P464, DOI 10.1109/BTAS.2017.8272731
[6]   Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Models [J].
Bond-Taylor, Sam ;
Leach, Adam ;
Long, Yang ;
Willcocks, Chris G. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (11) :7327-7347
[7]  
Boutros Fadi, 2023, 2023 IEEE 17th International Conference on Automatic Face and Gesture Recognition (FG), P1, DOI 10.1109/FG57933.2023.10042627
[8]   SFace: Privacy-friendly and Accurate Face Recognition using Synthetic Data [J].
Boutros, Fadi ;
Huber, Marco ;
Siebke, Patrick ;
Rieber, Tim ;
Damer, Naser .
2022 IEEE INTERNATIONAL JOINT CONFERENCE ON BIOMETRICS (IJCB), 2022,
[9]   QuantFace: Towards Lightweight Face Recognition by Synthetic Data Low-bit Quantization [J].
Boutros, Fadi ;
Damer, Naser ;
Kuijper, Arjan .
2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, :855-862
[10]   ElasticFace: Elastic Margin Loss for Deep Face Recognition [J].
Boutros, Fadi ;
Damer, Naser ;
Kirchbuchner, Florian ;
Kuijper, Arjan .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, :1577-1586