Source-Free Domain Adaptation With Domain Generalized Pretraining for Face Anti-Spoofing

被引:7
|
作者
Liu, Yuchen [1 ]
Chen, Yabo [2 ]
Dai, Wenrui [2 ]
Gou, Mengran [3 ]
Huang, Chun-Ting [3 ]
Xiong, Hongkai [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
[3] Qualcomm AI Res, Shanghai 201203, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain generalized pretraining; face anti-spoofing; source-free domain adaptation;
D O I
10.1109/TPAMI.2024.3370721
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Source-free domain adaptation (SFDA) shows the potential to improve the generalizability of deep learning-based face anti-spoofing (FAS) while preserving the privacy and security of sensitive human faces. However, existing SFDA methods are significantly degraded without accessing source data due to the inability to mitigate domain and identity bias in FAS. In this paper, we propose a novel Source-free Domain Adaptation framework for FAS (SDA-FAS) that systematically addresses the challenges of source model pre-training, source knowledge adaptation, and target data exploration under the source-free setting. Specifically, we develop a generalized method for source model pre-training that leverages a causality-inspired PatchMix data augmentation to diminish domain bias and designs the patch-wise contrastive loss to alleviate identity bias. For source knowledge adaptation, we propose a contrastive domain alignment module to align conditional distribution across domains with a theoretical equivalence to adaptation based on source data. Furthermore, target data exploration is achieved via self-supervised learning with patch shuffle augmentation to identify unseen attack types, which is ignored in existing SFDA methods. To our best knowledge, this paper provides the first full-stack privacy-preserving framework to address the generalization problem in FAS. Extensive experiments on nineteen cross-dataset scenarios show our framework considerably outperforms state-of-the-art methods.
引用
收藏
页码:5430 / 5448
页数:19
相关论文
共 50 条
  • [1] Source-Free Domain Adaptation with Contrastive Domain Alignment and Self-supervised Exploration for Face Anti-spoofing
    Liu, Yuchen
    Chen, Yabo
    Dai, Wenrui
    Gou, Mengran
    Huang, Chun-Ting
    Xiong, Hongkai
    COMPUTER VISION, ECCV 2022, PT XII, 2022, 13672 : 511 - 528
  • [2] Unsupervised Domain Adaptation for Face Anti-Spoofing
    Li, Haoliang
    Li, Wen
    Cao, Hong
    Wang, Shiqi
    Huang, Feiyue
    Kot, Alex C.
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2018, 13 (07) : 1794 - 1809
  • [3] Generative Domain Adaptation for Face Anti-Spoofing
    Zhou, Qianyu
    Zhang, Ke-Yue
    Yao, Taiping
    Yi, Ran
    Sheng, Kekai
    Ding, Shouhong
    Ma, Lizhuang
    COMPUTER VISION - ECCV 2022, PT V, 2022, 13665 : 335 - 356
  • [4] Domain-Generalized Face Anti-Spoofing with Domain Adaptive Style Extraction
    Yang, Sunghun
    Lee, Jungho
    Jang, Sungjun
    Kang, Minseok
    Lee, Yongju
    Lee, Sangyoun
    2024 INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS, AND COMMUNICATIONS, ITC-CSCC 2024, 2024,
  • [5] A Domain Generalized Face Anti-Spoofing System Using Domain Adversarial Learning
    Chen, Ching-Yi
    Jhong, Sin-Ye
    Hsia, Chih-Hsien
    INTERNATIONAL JOURNAL OF ENGINEERING AND TECHNOLOGY INNOVATION, 2024, 14 (04) : 378 - 388
  • [6] DOMAIN-GENERALIZED FACE ANTI-SPOOFING WITH UNKNOWN ATTACKS
    Hong, Zong-Wei
    Lin, Yu-Chen
    Liu, Hsuan-Tung
    Yeh, Yi-Ren
    Chen, Chu-Song
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 820 - 824
  • [7] Domain Adversarial Disentanglement Network With Cross-Domain Synthesis for Generalized Face Anti-Spoofing
    Yan, Wenjun
    Zeng, Ying
    Hu, Haifeng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (10) : 7033 - 7046
  • [8] Bottom-Up Domain Prompt Tuning for Generalized Face Anti-spoofing
    Liu, Si-Qi
    Wang, Qirui
    Yuen, Pong C.
    COMPUTER VISION - ECCV 2024, PT LXX, 2025, 15128 : 170 - 187
  • [9] Domain Generalization with Pseudo-Domain Label for Face Anti-spoofing
    Kim, Young Eun
    Lee, Seong-Whan
    PATTERN RECOGNITION, ACPR 2021, PT I, 2022, 13188 : 431 - 442
  • [10] Face anti-spoofing via conditional adversarial domain generalization
    Cai T.
    Chen F.
    Liu W.
    Xie X.
    Liu Z.
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 (12) : 16499 - 16512