An Enhanced Deep Learning-Based DeepFake Video Detection and Classification System

被引:13
作者
Awotunde, Joseph Bamidele [1 ]
Jimoh, Rasheed Gbenga [1 ]
Imoize, Agbotiname Lucky [2 ,3 ]
Abdulrazaq, Akeem Tayo [1 ]
Li, Chun-Ta [4 ,5 ]
Lee, Cheng-Chi [6 ,7 ]
机构
[1] Univ Ilorin, Fac Informat & Commun Sci, Dept Comp Sci, Ilorin 240003, Nigeria
[2] Univ Lagos, Fac Engn, Dept Elect & Elect Engn, Akoka 100213, Lagos, Nigeria
[3] Ruhr Univ, Inst Digital Commun, Dept Elect Engn & Informat Technol, D-44801 Bochum, Germany
[4] Fu Jen Catholic Univ, Program Artificial Intelligence & Informat Secur, New Taipei City 24206, Taiwan
[5] Tainan Univ Technol, Dept Informat Management, Tainan 71002, Taiwan
[6] Fu Jen Catholic Univ, Res & Dev Ctr Phys Educ Hlth & Informat Technol, Dept Lib & Informat Sci, New Taipei City 24206, Taiwan
[7] Asia Univ, Dept Comp Sci & Informat Engn, Taichung 41354, Taiwan
关键词
convolutional neural networks; DeepFake facial reconstruction; deep learning; DeepFake video detection; image alteration; generative adversarial networks; rectifying linear unit; recurrent neural networks;
D O I
10.3390/electronics12010087
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The privacy of individuals and entire countries is currently threatened by the widespread use of face-swapping DeepFake models, which result in a sizable number of fake videos that seem extraordinarily genuine. Because DeepFake production tools have advanced so much and since so many researchers and businesses are interested in testing their limits, fake media is spreading like wildfire over the internet. Therefore, this study proposes five-layered convolutional neural networks (CNNs) for a DeepFake detection and classification model. The CNN enhanced with ReLU is used to extract features from these faces once the model has extracted the face region from video frames. To guarantee model accuracy while maintaining a suitable weight, a CNN enabled with ReLU model was used for the DeepFake-detection-influenced video. The performance evaluation of the proposed model was tested using Face2Face, and first-order motion DeepFake datasets. Experimental results revealed that the proposed model has an average prediction rate of 98% for DeepFake videos and 95% for Face2Face videos under actual network diffusion circumstances. When compared with systems such as Meso4, MesoInception4, Xception, EfficientNet-B0, and VGG16 which utilizes the convolutional neural network, the suggested model produced the best results with an accuracy rate of 86%.
引用
收藏
页数:25
相关论文
共 55 条
[1]  
Adeniyi A.E., 2022, P INT C COMPUTATIONA, P476
[2]   Empirical Analysis of Data Streaming and Batch Learning Models for Network Intrusion Detection [J].
Adewole, Kayode S. ;
Salau-Ibrahim, Taofeekat T. ;
Imoize, Agbotiname Lucky ;
Oladipo, Idowu Dauda ;
AbdulRaheem, Muyideen ;
Awotunde, Joseph Bamidele ;
Balogun, Abdullateef O. ;
Isiaka, Rafiu Mope ;
Aro, Taye Oladele .
ELECTRONICS, 2022, 11 (19)
[3]  
Afchar D, 2018, IEEE INT WORKS INFOR
[4]  
Agarwal S., 2019, P IEEE CVF C COMP VI, P38, DOI DOI 10.4108/EAI.18-7-2019
[5]   RETRACTED: Deepfake detection using rationale-augmented convolutional neural network (Retracted Article) [J].
Ahmed, Saadaldeen Rashid Ahmed ;
Sonuc, Emrullah .
APPLIED NANOSCIENCE, 2021, 13 (2) :1485-1493
[6]  
Albahar M., 2019, Journal of Theoretical and Applied Infor0 mation Technology, V97, P3242
[7]  
Chandio A., 2022, ARXIV
[8]  
Chollet F., 2017, IEEE C COMPUT VIS PA, P1251
[9]  
Ciftci U.A., 2021, U.S. Patent, Patent No. [US20210209388A1, 20210209388]
[10]  
Ciftci Umur Aybars, 2020, IEEE Trans Pattern Anal Mach Intell, VPP, DOI 10.1109/TPAMI.2020.3009287