Source-Free Domain Adaptation With Domain Generalized Pretraining for Face Anti-Spoofing

被引:7
|
作者
Liu, Yuchen [1 ]
Chen, Yabo [2 ]
Dai, Wenrui [2 ]
Gou, Mengran [3 ]
Huang, Chun-Ting [3 ]
Xiong, Hongkai [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
[3] Qualcomm AI Res, Shanghai 201203, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain generalized pretraining; face anti-spoofing; source-free domain adaptation;
D O I
10.1109/TPAMI.2024.3370721
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Source-free domain adaptation (SFDA) shows the potential to improve the generalizability of deep learning-based face anti-spoofing (FAS) while preserving the privacy and security of sensitive human faces. However, existing SFDA methods are significantly degraded without accessing source data due to the inability to mitigate domain and identity bias in FAS. In this paper, we propose a novel Source-free Domain Adaptation framework for FAS (SDA-FAS) that systematically addresses the challenges of source model pre-training, source knowledge adaptation, and target data exploration under the source-free setting. Specifically, we develop a generalized method for source model pre-training that leverages a causality-inspired PatchMix data augmentation to diminish domain bias and designs the patch-wise contrastive loss to alleviate identity bias. For source knowledge adaptation, we propose a contrastive domain alignment module to align conditional distribution across domains with a theoretical equivalence to adaptation based on source data. Furthermore, target data exploration is achieved via self-supervised learning with patch shuffle augmentation to identify unseen attack types, which is ignored in existing SFDA methods. To our best knowledge, this paper provides the first full-stack privacy-preserving framework to address the generalization problem in FAS. Extensive experiments on nineteen cross-dataset scenarios show our framework considerably outperforms state-of-the-art methods.
引用
收藏
页码:5430 / 5448
页数:19
相关论文
共 50 条
  • [21] A novel generalized source-free domain adaptation approach for cross-domain industrial fault diagnosis
    Tian, Jilun
    Zhang, Jiusi
    Jiang, Yuchen
    Wu, Shimeng
    Luo, Hao
    Yin, Shen
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2024, 243
  • [22] MFAE: Masked Frequency Autoencoders for Domain Generalization Face Anti-Spoofing
    Zheng, Tianyi
    Li, Bo
    Wu, Shuang
    Wan, Ben
    Mu, Guodong
    Liu, Shice
    Ding, Shouhong
    Wang, Jia
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 (4058-4069) : 4058 - 4069
  • [23] Dual Teacher Knowledge Distillation With Domain Alignment for Face Anti-Spoofing
    Kong, Zhe
    Zhang, Wentian
    Wang, Tao
    Zhang, Kaihao
    Li, Yuexiang
    Tang, Xiaoying
    Luo, Wenhan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 13177 - 13189
  • [24] Uncertainty-Guided Source-Free Domain Adaptation
    Roy, Subhankar
    Trapp, Martin
    Pilzer, Andrea
    Kannala, Juho
    Sebe, Nicu
    Ricci, Elisa
    Solin, Arno
    COMPUTER VISION, ECCV 2022, PT XXV, 2022, 13685 : 537 - 555
  • [25] Source-free domain adaptation with Class Prototype Discovery
    Zhou, Lihua
    Li, Nianxin
    Ye, Mao
    Zhu, Xiatian
    Tang, Song
    PATTERN RECOGNITION, 2023, 145
  • [26] Source-Free Implicit Semantic Augmentation for Domain Adaptation
    Zhang, Zheyuan
    Zhang, Zili
    PRICAI 2022: TRENDS IN ARTIFICIAL INTELLIGENCE, PT II, 2022, 13630 : 17 - 31
  • [27] Source-Free Domain Adaptation for Optical Music Recognition
    Rosello, Adrian
    Fuentes-Martinez, Eliseo
    Alfaro-Contreras, Maria
    Rizo, David
    Calvo-Zaragoza, Jorge
    DOCUMENT ANALYSIS AND RECOGNITION-ICDAR 2024, PT VI, 2024, 14809 : 3 - 19
  • [28] Exploring Relational Knowledge for Source-Free Domain Adaptation
    Ma, You
    Chai, Lin
    Tu, Shi
    Wang, Qingling
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (02) : 1825 - 1839
  • [29] Semi-Supervised Generalized Source-Free Domain Adaptation (SSG-SFDA)
    An, Jiayu
    Zhao, Changming
    Wu, Dongrui
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [30] Adversarial learning and decomposition-based domain generalization for face anti-spoofing
    Liu, Mingxin
    Mu, Jiong
    Yu, Zitong
    Ruan, Kun
    Shu, Baiyi
    Yang, Jie
    PATTERN RECOGNITION LETTERS, 2022, 155 : 171 - 177