Source-Free Domain Adaptation With Domain Generalized Pretraining for Face Anti-Spoofing

被引:7
|
作者
Liu, Yuchen [1 ]
Chen, Yabo [2 ]
Dai, Wenrui [2 ]
Gou, Mengran [3 ]
Huang, Chun-Ting [3 ]
Xiong, Hongkai [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
[3] Qualcomm AI Res, Shanghai 201203, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain generalized pretraining; face anti-spoofing; source-free domain adaptation;
D O I
10.1109/TPAMI.2024.3370721
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Source-free domain adaptation (SFDA) shows the potential to improve the generalizability of deep learning-based face anti-spoofing (FAS) while preserving the privacy and security of sensitive human faces. However, existing SFDA methods are significantly degraded without accessing source data due to the inability to mitigate domain and identity bias in FAS. In this paper, we propose a novel Source-free Domain Adaptation framework for FAS (SDA-FAS) that systematically addresses the challenges of source model pre-training, source knowledge adaptation, and target data exploration under the source-free setting. Specifically, we develop a generalized method for source model pre-training that leverages a causality-inspired PatchMix data augmentation to diminish domain bias and designs the patch-wise contrastive loss to alleviate identity bias. For source knowledge adaptation, we propose a contrastive domain alignment module to align conditional distribution across domains with a theoretical equivalence to adaptation based on source data. Furthermore, target data exploration is achieved via self-supervised learning with patch shuffle augmentation to identify unseen attack types, which is ignored in existing SFDA methods. To our best knowledge, this paper provides the first full-stack privacy-preserving framework to address the generalization problem in FAS. Extensive experiments on nineteen cross-dataset scenarios show our framework considerably outperforms state-of-the-art methods.
引用
收藏
页码:5430 / 5448
页数:19
相关论文
共 50 条
  • [31] A Cross Domain Multi-modal Dataset for Robust Face Anti-spoofing
    Ji, Qiaobin
    Xu, Shugong
    Chen, Xudong
    Zhang, Shunqing
    Cao, Shan
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 4309 - 4316
  • [32] Towards Diverse Liveness Feature Representation and Domain Expansion for Cross-Domain Face Anti-Spoofing
    Huang, Pei-Kai
    Chong, Jun-Xiong
    Ni, Hui-Yu
    Chen, Tzu-Hsien
    Hsu, Chiou-Ting
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 1199 - 1204
  • [33] Category-Conditional Gradient Alignment for Domain Adaptive Face Anti-Spoofing
    He, Yan
    Peng, Fei
    Cai, Rizhao
    Yu, Zitong
    Long, Min
    Lam, Kwok-Yan
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 10071 - 10085
  • [34] Unified unsupervised and semi-supervised domain adaptation network for cross-scenario face anti-spoofing
    Jia, Yunpei
    Zhang, Jie
    Shan, Shiguang
    Chen, Xilin
    PATTERN RECOGNITION, 2021, 115
  • [35] Multi-domain mixup for scenario-universal face anti-spoofing
    Lu, Shitao
    Liu, Shice
    Zhang, Keyue
    Chen, Mingang
    Tan, Xin
    Ma, Lizhuang
    COMPUTERS & GRAPHICS-UK, 2023, 116 : 327 - 335
  • [36] Dual Consistency Regularization for Generalized Face Anti-Spoofing
    Liu, Yongluo
    Li, Zun
    Wu, Lifang
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2025, 20 : 2171 - 2183
  • [37] Source-Free Domain Adaptation for Point Cloud Semantic Segmentation
    Duan, Jianshe
    Zhang, Yachao
    Qu, Yanyun
    2024 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME 2024, 2024,
  • [38] Source-Free Open Compound Domain Adaptation in Semantic Segmentation
    Zhao, Yuyang
    Zhong, Zhun
    Luo, Zhiming
    Lee, Gim Hee
    Sebe, Nicu
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (10) : 7019 - 7032
  • [39] Reducing bias in source-free unsupervised domain adaptation for regression
    Zhan, Qianshan
    Zeng, Xiao-Jun
    Wang, Qian
    NEURAL NETWORKS, 2025, 185
  • [40] Casting a BAIT for offline and online source-free domain adaptation
    Yang, Shiqi
    Wang, Yaxing
    Herranz, Luis
    Jui, Shangling
    van de Weijer, Joost
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 234