Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detection

被引:209
作者
Li, Jiaming [1 ]
Xie, Hongtao [1 ]
Li, Jiahong [2 ]
Wang, Zhongyuan [2 ]
Zhang, Yongdong [1 ]
机构
[1] Univ Sci & Technol China, Hefei, Peoples R China
[2] Kuaishou Technol, Beijing, Peoples R China
来源
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021 | 2021年
关键词
D O I
10.1109/CVPR46437.2021.00639
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face forgery detection is raising ever-increasing interest in computer vision since facial manipulation technologies cause serious worries. Though recent works have reached sound achievements, there are still unignorable problems: a) learned features supervised by softmax loss are separable but not discriminative enough, since softmax loss does not explicitly encourage intra-class compactness and interclass separability; and b)fixed filter banks and hand-crafted features are insufficient to capture forgery patterns of frequency from diverse inputs. To compensate for such limitations, a novel frequency-aware discriminative feature learning framework is proposed in this paper. Specifically, we design a novel single-center loss (SCL) that only compresses intra-class variations of natural faces while boosting interclass differences in the embedding space. In such a case, the network can learn more discriminative features with less optimization difficulty. Besides, an adaptive frequency feature generation module is developed to mine frequency clues in a completely data-driven fashion. With the above two modules, the whole framework can learn more discriminative features in an end-to-end manner. Extensive experiments demonstrate the effectiveness and superiority of our framework on three versions of the FF++ dataset.
引用
收藏
页码:6454 / 6463
页数:10
相关论文
共 45 条
[21]   MaskGAN: Towards Diverse and Interactive Facial Image Manipulation [J].
Lee, Cheng-Han ;
Liu, Ziwei ;
Wu, Lingyun ;
Luo, Ping .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :5548-5557
[22]   Face X-ray for More General Face Forgery Detection [J].
Li, Lingzhi ;
Bao, Jianmin ;
Zhang, Ting ;
Yang, Hao ;
Chen, Dong ;
Wen, Fang ;
Guo, Baining .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :5000-5009
[23]  
[李艳歌 Li Yange], 2018, [高分子通报, Polymer Bulletin], P46
[24]   Bidirectional Attention-Recognition Model for Fine-Grained Object Classification [J].
Liu, Chuanbin ;
Xie, Hongtao ;
Zha, Zhengjun ;
Yu, Lingyun ;
Chen, Zhineng ;
Zhang, Yongdong .
IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (07) :1785-1795
[25]  
Liu WY, 2016, PR MACH LEARN RES, V48
[26]   Two-Branch Recurrent Network for Isolating Deepfakes in Videos [J].
Masi, Iacopo ;
Killekar, Aditya ;
Mascarenhas, Royston Marian ;
Gurudatt, Shenoy Pratik ;
AbdAlmageed, Wael .
COMPUTER VISION - ECCV 2020, PT VII, 2020, 12352 :667-684
[27]   ANALYZING A PORTION OF THE ROC CURVE [J].
MCCLISH, DK .
MEDICAL DECISION MAKING, 1989, 9 (03) :190-195
[28]   Multi-Objective Matrix Normalization for Fine-Grained Visual Recognition [J].
Min, Shaobo ;
Yao, Hantao ;
Xie, Hongtao ;
Zha, Zheng-Jun ;
Zhang, Yongdong .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :4996-5009
[29]  
Paszke A, 2019, ADV NEUR IN, V32
[30]   DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms [J].
Qi, Hua ;
Guo, Qing ;
Juefei-Xu, Felix ;
Xie, Xiaofei ;
Ma, Lei ;
Feng, Wei ;
Liu, Yang ;
Zhao, Jianjun .
MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, :4318-4327