Implicit Identity Driven Deepfake Face Swapping Detection

被引:74
作者
Huang, Baojin [1 ]
Wang, Zhongyuan [1 ]
Yang, Jifan [1 ]
Ai, Jiaxin [1 ]
Zou, Qin [1 ]
Wang, Qian [2 ]
Ye, Dengpan [2 ]
机构
[1] Wuhan Univ, Sch Comp Sci, NERCMS, Wuhan, Peoples R China
[2] Wuhan Univ, Sch Cyber Sci & Engn, Wuhan, Peoples R China
来源
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR | 2023年
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR52729.2023.00436
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we consider the face swapping detection from the perspective of face identity. Face swapping aims to replace the target face with the source face and generate the fake face that the human cannot distinguish between real and fake. We argue that the fake face contains the explicit identity and implicit identity, which respectively corresponds to the identity of the source face and target face during face swapping. Note that the explicit identities of faces can be extracted by regular face recognizers. Particularly, the implicit identity of real face is consistent with the its explicit identity. Thus the difference between explicit and implicit identity of face facilitates face swapping detection. Following this idea, we propose a novel implicit identity driven framework for face swapping detection. Specifically, we design an explicit identity contrast (EIC) loss and an implicit identity exploration (IIE) loss, which supervises a CNN backbone to embed face images into the implicit identity space. Under the guidance of EIC, real samples are pulled closer to their explicit identities, while fake samples are pushed away from their explicit identities. Moreover, IIE is derived from the margin-based classification loss function, which encourages the fake faces with known target identities to enjoy intra-class compactness and interclass diversity. Extensive experiments and visualizations on several datasets demonstrate the generalization of our method against the state-of-the-art counterparts.
引用
收藏
页码:4490 / 4499
页数:10
相关论文
共 56 条
[1]  
Afchar Darius., 2018, 2018 IEEE International Workshop on Information Forensics and Security WIFS, P1, DOI [10.1109/wifs.2018.8630761, DOI 10.1109/WIFS.2018.8630761]
[2]   Towards Open-Set Identity Preserving Face Synthesis [J].
Bao, Jianmin ;
Chen, Dong ;
Wen, Fang ;
Li, Houqiang ;
Hua, Gang .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6713-6722
[3]  
CAO J, 2022, IEEE CVPR
[4]   Metric Learning for Anti-Compression Facial Forgery Detection [J].
Cao, Shenhao ;
Zou, Qin ;
Mao, Xiuqing ;
Ye, Dengpan ;
Wang, Zhongyuan .
PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, :1929-1937
[5]   Everybody Dance Now [J].
Chan, Caroline ;
Ginosar, Shiry ;
Zhou, Tinghui ;
Efros, Alexei A. .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :5932-5941
[6]   SimSwap: An Efficient Framework For High Fidelity Face Swapping [J].
Chen, Renwang ;
Chen, Xuanhong ;
Ni, Bingbing ;
Ge, Yanhao .
MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, :2003-2011
[7]  
Chen S, 2021, AAAI CONF ARTIF INTE, V35, P1081
[8]  
Chollet Francois, 2017, PROC CVPR IEEE, P1800, DOI [DOI 10.1109/CVPR.2017.195, 10.48550/arXiv.1610.02357, DOI 10.48550/ARXIV.1610.02357, 10.1109/CVPR.2017.195, 10.1109/CVPR.2017.195.5]
[9]  
Cozzolino Davide., 2018, FORENSICTRANSFER WEA
[10]   On the Detection of Digital Face Manipulation [J].
Dang, Hao ;
Liu, Feng ;
Stehouwer, Joel ;
Liu, Xiaoming ;
Jain, Anil K. .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :5780-5789