Learning Meta Pattern for Face Anti-Spoofing

被引:53
作者
Cai, Rizhao [1 ]
Li, Zhi [2 ]
Wan, Renjie [3 ]
Li, Haoliang [4 ]
Hu, Yongjian [5 ,6 ]
Kot, Alex C. [1 ,6 ]
机构
[1] Nanyang Technol Univ, ROSE Lab, Sch Elect & Elect Engn, Singapore 639798, Singapore
[2] Nanyang Technol Univ, Sch Comp Sci Engn, Singapore 639798, Singapore
[3] Hong Kong Baptist Univ, Dept Comp Sci, Hong Kong, Peoples R China
[4] City Univ Hong Kong, Dept Elect Engn, Hong Kong, Peoples R China
[5] South China Univ Technol, Sch Elect & Informat Engn, Wushan Campus, Guangzhou 510641, Peoples R China
[6] China Singapore Int Joint Res Inst, Guangzhou 510555, Peoples R China
关键词
Feature extraction; Face recognition; Neural networks; Faces; Deep learning; Optimization; Data mining; Face Anti-Spoofing (FAS); Face Presentation Attack Detection (Face PAD); domain generalization; Meta Pattern (MP); DOMAIN ADAPTATION;
D O I
10.1109/TIFS.2022.3158551
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Face Anti-Spoofing (FAS) is essential to secure face recognition systems and has been extensively studied in recent years. Although deep neural networks (DNNs) for the FAS task have achieved promising results in intra-dataset experiments with similar distributions of training and testing data, the DNNs' generalization ability is limited under the cross-domain scenarios with different distributions of training and testing data. To improve the generalization ability, recent hybrid methods have been explored to extract task-aware handcrafted features (e.g., Local Binary Pattern) as discriminative information for the input of DNNs. However, the handcrafted feature extraction relies on experts' domain knowledge, and how to choose appropriate handcrafted features is underexplored. To this end, we propose a learnable network to extract Meta Pattern (MP) in our learning-to-learn framework. By replacing handcrafted features with the MP, the discriminative information from MP is capable of learning a more generalized model. Moreover, we devise a two-stream network to hierarchically fuse the input RGB image and the extracted MP by using our proposed Hierarchical Fusion Module (HFM). We conduct comprehensive experiments and show that our MP outperforms the compared handcrafted features. Also, our proposed method with HFM and the MP can achieve state-of-the-art performance on two different domain generalization evaluation benchmarks.
引用
收藏
页码:1201 / 1213
页数:13
相关论文
共 61 条
[1]  
[Anonymous], 2014, COMPUT RES REPOSITOR
[2]  
[Anonymous], 2011, 2011 INT JOINT C BIO, DOI DOI 10.1109/IJCB.2011.6117510
[3]  
[Anonymous], 2011, P INT JOINT C BIOM I, DOI DOI 10.1109/IJCB.2011.6117503
[4]  
[Anonymous], 2012, BIOSIG
[5]  
Asim M, 2017, 2017 2ND INTERNATIONAL CONFERENCE ON IMAGE, VISION AND COMPUTING (ICIVC 2017), P234, DOI 10.1109/ICIVC.2017.7984552
[6]   Face Antispoofing Using Speeded-Up Robust Features and Fisher Vector Encoding [J].
Boulkenafet, Zinelabidine ;
Komulainen, Jukka ;
Hadid, Abdenour .
IEEE SIGNAL PROCESSING LETTERS, 2017, 24 (02) :141-145
[7]   Face Spoofing Detection Using Colour Texture Analysis [J].
Boulkenafet, Zinelabidine ;
Komulainen, Jukka ;
Hadid, Abdenour .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2016, 11 (08) :1818-1830
[8]   OULU-NPU: A mobile face presentation attack database with real-world variations [J].
Boulkenafet, Zinelabinde ;
Komulainen, Jukka ;
Li, Lei ;
Feng, Xiaoyi ;
Hadid, Abdenour .
2017 12TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2017), 2017, :612-618
[9]  
Cai R., 2019, ARXIV191003850
[10]   DRL-FAS: A Novel Framework Based on Deep Reinforcement Learning for Face Anti-Spoofing [J].
Cai, Rizhao ;
Li, Haoliang ;
Wang, Shiqi ;
Chen, Changsheng ;
Kot, Alex C. .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2021, 16 :937-951