Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detection

被引:209
作者
Li, Jiaming [1 ]
Xie, Hongtao [1 ]
Li, Jiahong [2 ]
Wang, Zhongyuan [2 ]
Zhang, Yongdong [1 ]
机构
[1] Univ Sci & Technol China, Hefei, Peoples R China
[2] Kuaishou Technol, Beijing, Peoples R China
来源
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021 | 2021年
关键词
D O I
10.1109/CVPR46437.2021.00639
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face forgery detection is raising ever-increasing interest in computer vision since facial manipulation technologies cause serious worries. Though recent works have reached sound achievements, there are still unignorable problems: a) learned features supervised by softmax loss are separable but not discriminative enough, since softmax loss does not explicitly encourage intra-class compactness and interclass separability; and b)fixed filter banks and hand-crafted features are insufficient to capture forgery patterns of frequency from diverse inputs. To compensate for such limitations, a novel frequency-aware discriminative feature learning framework is proposed in this paper. Specifically, we design a novel single-center loss (SCL) that only compresses intra-class variations of natural faces while boosting interclass differences in the embedding space. In such a case, the network can learn more discriminative features with less optimization difficulty. Besides, an adaptive frequency feature generation module is developed to mine frequency clues in a completely data-driven fashion. With the above two modules, the whole framework can learn more discriminative features in an end-to-end manner. Extensive experiments demonstrate the effectiveness and superiority of our framework on three versions of the FF++ dataset.
引用
收藏
页码:6454 / 6463
页数:10
相关论文
共 45 条
[1]  
Afchar D, 2018, IEEE INT WORKS INFOR
[2]  
Agarwal S, 2019, P IEEE C COMPUTER VI, V1, P1, DOI [10.4108/eai.18-7-2019, DOI 10.4108/EAI.18-7-2019]
[3]  
[Anonymous], 2016, P 4 ACM WORKSH INF H
[4]  
[Anonymous], 2017, Proceedings of the IEEE Workshop on Information Forensics and Security
[5]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[6]   Recasting Residual-based Local Descriptors as Convolutional Neural Networks: an Application to Image Forgery Detection [J].
Cozzolino, Davide ;
Poggi, Giovanni ;
Verdoliva, Luisa .
IH&MMSEC'17: PROCEEDINGS OF THE 2017 ACM WORKSHOP ON INFORMATION HIDING AND MULTIMEDIA SECURITY, 2017, :159-164
[7]  
Cozzolino Davide, 2018, FORENSICTRANSFER WEA
[8]   On the Detection of Digital Face Manipulation [J].
Dang, Hao ;
Liu, Feng ;
Stehouwer, Joel ;
Liu, Xiaoming ;
Jain, Anil K. .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :5780-5789
[9]   RetinaFace: Single-shot Multi-level Face Localisation in the Wild [J].
Deng, Jiankang ;
Guo, Jia ;
Ververas, Evangelos ;
Kotsia, Irene ;
Zafeiriou, Stefanos .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :5202-5211
[10]   Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learning [J].
Deng, Yu ;
Yang, Jiaolong ;
Chen, Dong ;
Wen, Fang ;
Tong, Xin .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :5153-5162