Source-Free Domain Adaptation With Domain Generalized Pretraining for Face Anti-Spoofing

被引:7
|
作者
Liu, Yuchen [1 ]
Chen, Yabo [2 ]
Dai, Wenrui [2 ]
Gou, Mengran [3 ]
Huang, Chun-Ting [3 ]
Xiong, Hongkai [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
[3] Qualcomm AI Res, Shanghai 201203, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain generalized pretraining; face anti-spoofing; source-free domain adaptation;
D O I
10.1109/TPAMI.2024.3370721
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Source-free domain adaptation (SFDA) shows the potential to improve the generalizability of deep learning-based face anti-spoofing (FAS) while preserving the privacy and security of sensitive human faces. However, existing SFDA methods are significantly degraded without accessing source data due to the inability to mitigate domain and identity bias in FAS. In this paper, we propose a novel Source-free Domain Adaptation framework for FAS (SDA-FAS) that systematically addresses the challenges of source model pre-training, source knowledge adaptation, and target data exploration under the source-free setting. Specifically, we develop a generalized method for source model pre-training that leverages a causality-inspired PatchMix data augmentation to diminish domain bias and designs the patch-wise contrastive loss to alleviate identity bias. For source knowledge adaptation, we propose a contrastive domain alignment module to align conditional distribution across domains with a theoretical equivalence to adaptation based on source data. Furthermore, target data exploration is achieved via self-supervised learning with patch shuffle augmentation to identify unseen attack types, which is ignored in existing SFDA methods. To our best knowledge, this paper provides the first full-stack privacy-preserving framework to address the generalization problem in FAS. Extensive experiments on nineteen cross-dataset scenarios show our framework considerably outperforms state-of-the-art methods.
引用
收藏
页码:5430 / 5448
页数:19
相关论文
共 50 条
  • [41] Domain-Adaptive Energy-Based Models for Generalizable Face Anti-Spoofing
    Zhang, Dan
    Du, Zhekai
    Li, Jingjing
    Zhu, Lei
    Shen, Heng Tao
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 10474 - 10488
  • [42] Adversarial Learning Domain-Invariant Conditional Features for Robust Face Anti-spoofing
    Fangling Jiang
    Qi Li
    Pengcheng Liu
    Xiang-Dong Zhou
    Zhenan Sun
    International Journal of Computer Vision, 2023, 131 : 1680 - 1703
  • [43] Generation, augmentation, and alignment: a pseudo-source domain based method for source-free domain adaptation
    Yuntao Du
    Haiyang Yang
    Mingcai Chen
    Hongtao Luo
    Juan Jiang
    Yi Xin
    Chongjun Wang
    Machine Learning, 2024, 113 : 3611 - 3631
  • [44] Open-Set Single-Domain Generalization for Robust Face Anti-Spoofing
    Jiang, Fangling
    Li, Qi
    Wang, Weining
    Ren, Min
    Shen, Wei
    Liu, Bing
    Sun, Zhenan
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (11) : 5151 - 5172
  • [45] Generation, augmentation, and alignment: a pseudo-source domain based method for source-free domain adaptation
    Du, Yuntao
    Yang, Haiyang
    Chen, Mingcai
    Luo, Hongtao
    Jiang, Juan
    Xin, Yi
    Wang, Chongjun
    MACHINE LEARNING, 2024, 113 (06) : 3611 - 3631
  • [46] COMBINING DYNAMIC IMAGE AND PREDICTION ENSEMBLE FOR CROSS-DOMAIN FACE ANTI-SPOOFING
    Lv, Lingling
    Xiang, Youjun
    Li, Xianfeng
    Huang, Hanye
    Ruan, Rongju
    Xu, Xiaoyan
    Fu, Yuli
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 2550 - 2554
  • [47] Adversarial Learning Domain-Invariant Conditional Features for Robust Face Anti-spoofing
    Jiang, Fangling
    Li, Qi
    Liu, Pengcheng
    Zhou, Xiang-Dong
    Sun, Zhenan
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2023, 131 (07) : 1680 - 1703
  • [48] CSDG-FAS: Closed-Space Domain Generalization for Face Anti-spoofing
    Wang, Keyao
    Zhang, Guosheng
    Yue, Haixiao
    Liang, Yanyan
    Huang, Mouxiao
    Zhang, Gang
    Han, Junyu
    Ding, Errui
    Wang, Jingdong
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (11) : 4866 - 4879
  • [49] Surveillance Face Anti-Spoofing
    Fang, Hao
    Liu, Ajian
    Wan, Jun
    Escalera, Sergio
    Zhao, Chenxu
    Zhang, Xu
    Li, Stan Z.
    Lei, Zhen
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 1535 - 1546
  • [50] Towards face anti-spoofing
    Syed, Muhammad Ibrahim
    Asif, Amina
    Shahzad, Mohsin
    Khan, Uzair
    Khan, Sumair
    Mahmood, Zahid
    JOURNAL OF EXPERIMENTAL & THEORETICAL ARTIFICIAL INTELLIGENCE, 2023,