Dual Spoof Disentanglement Generation for Face Anti-Spoofing With Depth Uncertainty Learning

被引:28
|
作者
Wu, Hangtong [1 ]
Zeng, Dan [1 ]
Hu, Yibo [2 ]
Shi, Hailin [2 ]
Mei, Tao [2 ]
机构
[1] Shanghai Univ, Dept Commun Engn, Shanghai 200444, Peoples R China
[2] JD AI Res, Beijing 100020, Peoples R China
关键词
Faces; Training; Face recognition; Uncertainty; Feature extraction; Generators; Soft sensors; Face anti-spoofing; dual spoof disentanglement generation; depth uncertainty learning; PRESENTATION ATTACK DETECTION; DOMAIN ADAPTATION; REPRESENTATIONS;
D O I
10.1109/TCSVT.2021.3133620
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Face anti-spoofing (FAS) plays a vital role in preventing face recognition systems from presentation attacks. Existing face anti-spoofing datasets lack diversity due to the insufficient identity and insignificant variance, which limits the generalization ability of FAS model. In this paper, we propose Dual Spoof Disentanglement Generation (DSDG) framework to tackle this challenge by "anti-spoofing via generation". Depending on the interpretable factorized latent disentanglement in Variational Autoencoder (VAE), DSDG learns a joint distribution of the identity representation and the spoofing pattern representation in the latent space. Then, large-scale paired live and spoofing images can be generated from random noise to boost the diversity of the training set. However, some generated face images are partially distorted due to the inherent defect of VAE. Such noisy samples are hard to predict precise depth values, thus may obstruct the widely-used depth supervised optimization. To tackle this issue, we further introduce a lightweight Depth Uncertainty Module (DUM), which alleviates the adverse effects of noisy samples by depth uncertainty learning. DUM is developed without extra-dependency, thus can be flexibly integrated with any depth supervised network for face anti-spoofing. We evaluate the effectiveness of the proposed method on five popular benchmarks and achieve state-of-the-art results under both intra- and inter- test settings. The codes are available at https://github.com/JDAI-CV/FaceX-Zoo/tree/main/addition_module/DSDG.
引用
收藏
页码:4626 / 4638
页数:13
相关论文
共 50 条
  • [1] Spoof Trace Disentanglement for Generic Face Anti-Spoofing
    Liu, Yaojie
    Liu, Xiaoming
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) : 3813 - 3830
  • [2] Dual feature disentanglement for face anti-spoofing
    Ma, Yimei
    Qian, Jianjun
    Li, Jun
    Yang, Jian
    PATTERN RECOGNITION, 2024, 155
  • [3] Learning Polysemantic Spoof Trace: A Multi-Modal Disentanglement Network for Face Anti-spoofing
    Li, Kaicheng
    Yang, Hongyu
    Chen, Binghui
    Li, Pengyu
    Wang, Biao
    Huang, Di
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 1351 - 1359
  • [4] DANet: Dynamic Attention to Spoof Patterns for Face Anti-Spoofing
    Sun, Chun-Yu
    Chen, Song-Lu
    Li, Xin-Jie
    Chen, Feng
    Yin, Xu-Cheng
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 1929 - 1936
  • [5] Spoof-Guided Image Decomposition for Face Anti-spoofing
    Zhang, Bin
    Zhu, Xiangyu
    Zhang, Xiaoyu
    Chen, Shukai
    Li, Peng
    Lei, Zhen
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT V, 2024, 14429 : 3 - 15
  • [6] Advanced Face Anti-Spoofing with Depth Segmentation
    Zhang, Licheng
    Sun, Nan
    Wu, Xihong
    Luo, Dingsheng
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [7] Robust face anti-spoofing with depth information
    Wang, Yan
    Nian, Fudong
    Li, Teng
    Meng, Zhijun
    Wang, Kongqiao
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2017, 49 : 332 - 337
  • [8] Deep Spatial Gradient and Temporal Depth Learning for Face Anti-spoofing
    Wang, Zezheng
    Yu, Zitong
    Zhao, Chenxu
    Zhu, Xiangyu
    Qin, Yunxiao
    Zhou, Qiusheng
    Zhou, Feng
    Lei, Zhen
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5041 - 5050
  • [9] Domain Adaptation for Face Anti-Spoofing Based on Dual Disentanglement and Liveness Feature Progressive Alignment
    Feng J.
    Shi Y.
    Gao Y.
    He J.
    Yu Z.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2023, 60 (08): : 1727 - 1739
  • [10] DEPTH-BASED ENSEMBLE LEARNING NETWORK FOR FACE ANTI-SPOOFING
    Jiang, Jie
    Sun, Yunlian
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2954 - 2958