Anti-Forensics for Face Swapping Videos via Adversarial Training

被引:92
作者
Ding, Feng [1 ]
Zhu, Guopu [2 ,3 ]
Li, Yingcan [3 ]
Zhang, Xinpeng [4 ]
Atrey, Pradeep K. [5 ]
Lyu, Siwei [6 ]
机构
[1] Nanchang Univ, Sch Management, Nanchang 330031, Jiangxi, Peoples R China
[2] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin 150001, Peoples R China
[3] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Peoples R China
[4] Fudan Univ, Sch Comp Sci, Shanghai 200433, Peoples R China
[5] SUNY Albany, Albany, NY 12222 USA
[6] SUNY Buffalo, Buffalo, NY 14222 USA
基金
美国国家科学基金会; 中国国家自然科学基金;
关键词
Videos; Information integrity; Faces; Forensics; Detectors; Visualization; Tools; Digital forensics; anti-forensics; DeepFake; generative adversarial network;
D O I
10.1109/TMM.2021.3098422
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Generating falsified faces by artificial intelligence, widely known as DeepFake, has attracted attention worldwide since 2017. Given the potential threat brought by this novel technique, forensics researchers dedicated themselves to detect the video forgery. Except for exposing falsified faces, there could be extended research directions for DeepFake such as anti-forensics. It can disclose the vulnerability of current DeepFake forensics methods. Besides, it could also enable DeepFake videos as tactical weapons if the falsified faces are more subtle to be detected. In this paper, we propose a GAN model to behave as an anti-forensics tool. It features a novel architecture with additional supervising modules for enhancing image visual quality. Besides, a loss function is designed to improve the efficiency of the proposed model. After experimental evaluations, we show that the DeepFake forensics detectors are susceptible to attacks launched by the proposed method. Besides, the proposed method can efficiently produce anti-forensics videos in satisfying visual quality without noticeable artifacts. Compared with the other anti-forensics approaches, this is tremendous progress achieved for DeepFake anti-forensics. The attack launched by our proposed method can be truly regarded as DeepFake anti-forensics as it can fool detecting algorithms and human eyes simultaneously.
引用
收藏
页码:3429 / 3441
页数:13
相关论文
共 50 条
[1]  
Afchar D, 2018, IEEE INT WORKS INFOR
[2]  
Arjovsky M, 2017, PR MACH LEARN RES, V70
[3]   Unsharp Masking Sharpening Detection via Overshoot Artifacts Analysis [J].
Cao, Gang ;
Zhao, Yao ;
Ni, Rongrong ;
Kot, Alex C. .
IEEE SIGNAL PROCESSING LETTERS, 2011, 18 (10) :603-606
[4]   A Serial Image Copy-Move Forgery Localization Scheme With Source/Target Distinguishment [J].
Chen, Beijing ;
Tan, Weijin ;
Coatrieux, Gouenou ;
Zheng, Yuhui ;
Shi, Yun-Qing .
IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 :3506-3517
[5]  
Chen C., 2019, IEEE T INF FORENSICS, DOI [10.1109/TIFS.2019.2945198, DOI 10.1109/TIFS.2019.2945198, 10.1109/ TIFS.2019.2945198]
[6]   Deep Fakes: A Looming Challenge for Privacy, Democracy, and National Security [J].
Chesney, Bobby ;
Citron, Danielle .
CALIFORNIA LAW REVIEW, 2019, 107 (06) :1753-1819
[7]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[8]   Towards Diverse and Natural Image Descriptions via a Conditional GAN [J].
Dai, Bo ;
Fidler, Sanja ;
Urtasun, Raquel ;
Lin, Dahua .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2989-2998
[9]   METEOR: Measurable Energy Map Toward the Estimation of Resampling Rate via a Convolutional Neural Network [J].
Ding, Feng ;
Wu, Hanzhou ;
Zhu, Guopu ;
Shi, Yun-Qing .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (12) :4715-4727
[10]   An efficient weak sharpening detection method for image forensics [J].
Ding, Feng ;
Zhu, Guopu ;
Dong, Weiqiang ;
Shi, Yun-Qing .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 50 :93-99