Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detection

被引:209
作者
Li, Jiaming [1 ]
Xie, Hongtao [1 ]
Li, Jiahong [2 ]
Wang, Zhongyuan [2 ]
Zhang, Yongdong [1 ]
机构
[1] Univ Sci & Technol China, Hefei, Peoples R China
[2] Kuaishou Technol, Beijing, Peoples R China
来源
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021 | 2021年
关键词
D O I
10.1109/CVPR46437.2021.00639
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face forgery detection is raising ever-increasing interest in computer vision since facial manipulation technologies cause serious worries. Though recent works have reached sound achievements, there are still unignorable problems: a) learned features supervised by softmax loss are separable but not discriminative enough, since softmax loss does not explicitly encourage intra-class compactness and interclass separability; and b)fixed filter banks and hand-crafted features are insufficient to capture forgery patterns of frequency from diverse inputs. To compensate for such limitations, a novel frequency-aware discriminative feature learning framework is proposed in this paper. Specifically, we design a novel single-center loss (SCL) that only compresses intra-class variations of natural faces while boosting interclass differences in the embedding space. In such a case, the network can learn more discriminative features with less optimization difficulty. Besides, an adaptive frequency feature generation module is developed to mine frequency clues in a completely data-driven fashion. With the above two modules, the whole framework can learn more discriminative features in an end-to-end manner. Extensive experiments demonstrate the effectiveness and superiority of our framework on three versions of the FF++ dataset.
引用
收藏
页码:6454 / 6463
页数:10
相关论文
共 45 条
[31]  
Rezende DJ, 2014, PR MACH LEARN RES, V32, P1278
[32]   FaceForensics plus plus : Learning to Detect Manipulated Facial Images [J].
Roessler, Andreas ;
Cozzolino, Davide ;
Verdoliva, Luisa ;
Riess, Christian ;
Thies, Justus ;
Niessner, Matthias .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :1-11
[33]  
Schroff F, 2015, PROC CVPR IEEE, P815, DOI 10.1109/CVPR.2015.7298682
[34]   Interpreting the Latent Space of GANs for Semantic Face Editing [J].
Shen, Yujun ;
Gu, Jinjin ;
Tang, Xiaoou ;
Zhou, Bolei .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :9240-9249
[35]  
Thies J., 2016, PROC CVPR IEEE, DOI [DOI 10.1109/CVPR.2016.262, 10.1109/CVPR.2016.262]
[36]   Deferred Neural Rendering: Image Synthesis using Neural Textures [J].
Thies, Justus ;
Zollhofer, Michael ;
Niessner, Matthias .
ACM TRANSACTIONS ON GRAPHICS, 2019, 38 (04)
[37]  
van der Maaten L, 2008, J MACH LEARN RES, V9, P2579
[38]  
Wang Q, 2020, IEEE INT SYMP INFO, P1753, DOI [10.1109/ISIT44484.2020.9174163, 10.1109/isit44484.2020.9174163]
[39]   CNN-generated images are surprisingly easy to spot... for now [J].
Wang, Sheng-Yu ;
Wang, Oliver ;
Zhang, Richard ;
Owens, Andrew ;
Efros, Alexei A. .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :8692-8701
[40]   A Discriminative Feature Learning Approach for Deep Face Recognition [J].
Wen, Yandong ;
Zhang, Kaipeng ;
Li, Zhifeng ;
Qiao, Yu .
COMPUTER VISION - ECCV 2016, PT VII, 2016, 9911 :499-515