DeepFake Detection for Human Face Images and Videos: A Survey

被引:69
作者
Malik, Asad [1 ]
Kuribayashi, Minoru [2 ]
Abdullahi, Sani M. [3 ]
Khan, Ahmad Neyaz [4 ]
机构
[1] Aligarh Muslim Univ, Dept Comp Sci, Aligarh 202002, Uttar Pradesh, India
[2] Okayama Univ, Dept Elect & Commun Engn, Okayama 7008530, Japan
[3] China Three Gorges Univ, Coll Comp & Informat Technol, Yichang 443002, Peoples R China
[4] Integral Univ, Dept Comp Applicat, Lucknow 611731, Uttar Pradesh, India
关键词
Information integrity; Videos; Deep learning; Media; Kernel; Forensics; Faces; DeepFake; CNNs; GANs; NETWORKS;
D O I
10.1109/ACCESS.2022.3151186
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Techniques for creating and manipulating multimedia information have progressed to the point where they can now ensure a high degree of realism. DeepFake is a generative deep learning algorithm that creates or modifies face features in a superrealistic form, in which it is difficult to distinguish between real and fake features. This technology has greatly advanced and promotes a wide range of applications in TV channels, video game industries, and cinema, such as improving visual effects in movies, as well as a variety of criminal activities, such as misinformation generation by mimicking famous people. To identify and classify DeepFakes, research in DeepFake detection using deep neural networks (DNNs) has attracted increased interest. Basically, DeepFake is the regenerated media that is obtained by injecting or replacing some information within the DNN model. In this survey, we will summarize the DeepFake detection methods in face images and videos on the basis of their results, performance, methodology used and detection type. We will review the existing types of DeepFake creation techniques and sort them into five major categories. Generally, DeepFake models are trained on DeepFake datasets and tested with experiments. Moreover, we will summarize the available DeepFake dataset trends, focusing on their improvements. Additionally, the issue of how DeepFake detection aims to generate a generalized DeepFake detection model will be analyzed. Finally, the challenges related to DeepFake creation and detection will be discussed. We hope that the knowledge encompassed in this survey will accelerate the use of deep learning in face image and video DeepFake detection methods.
引用
收藏
页码:18757 / 18775
页数:19
相关论文
共 126 条
[1]  
Afchar D., 2018, 2018 IEEE INT WORKSH, P1
[2]   Detecting Deep-Fake Videos from Phoneme-Viseme Mismatches [J].
Agarwal, Shruti ;
Farid, Hany ;
Fried, Ohad ;
Agrawala, Maneesh .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :2814-2822
[3]  
Agarwal S., 2019, P IEEE CVF C COMP VI, P38, DOI [10.4108/eai.18-7-2019, DOI 10.4108/EAI.18-7-2019]
[4]   Detecting Deep-Fake Videos from Appearance and Behavior [J].
Agarwal, Shruti ;
Farid, Hany ;
El-Gaaly, Tarek ;
Lim, Ser-Nam .
2020 IEEE INTERNATIONAL WORKSHOP ON INFORMATION FORENSICS AND SECURITY (WIFS), 2020,
[5]   A SIFT-Based Forensic Method for Copy-Move Attack Detection and Transformation Recovery [J].
Amerini, Irene ;
Ballan, Lamberto ;
Caldelli, Roberto ;
Del Bimbo, Alberto ;
Serra, Giuseppe .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2011, 6 (03) :1099-1110
[6]  
[Anonymous], 2017, arXiv preprint arXiv:1711.10678
[7]  
[Anonymous], 2018, ASSESSMENT DETECTION
[8]  
[Anonymous], 2015, WILD WEB TAMPERED IM
[9]  
Baldi P., 2012, Autoencoders, unsupervised learning, and deep architectures
[10]   SURF: Speeded up robust features [J].
Bay, Herbert ;
Tuytelaars, Tinne ;
Van Gool, Luc .
COMPUTER VISION - ECCV 2006 , PT 1, PROCEEDINGS, 2006, 3951 :404-417