Three-Dimensional Convolutional Approaches for the Verification of Deepfake Videos: The Effect of Image Depth Size on Authentication Performance

被引:2
作者
Saealal, Muhammad Salihin [1 ]
Ibrahim, Mohd Zamri [2 ]
Yakno, Marlina [2 ]
Arshad, Nurul Wahidah [2 ]
机构
[1] Univ Teknikal Malaysia Melaka, Fac Elect & Elect Engn Technol, Melaka, Malaysia
[2] Univ Malaysia Pahang, Fac Elect & Elect Engn Technol, Pekan, Pahang, Malaysia
关键词
video forensic; deep learning; face forensic; 3-D convolution neural network; recurrent neural network; different sequence; online learning environment; NEURAL-NETWORKS;
D O I
10.12720/jait.14.3.488-494
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep learning has proven to be particularly effective in tasks such as data analysis, computer vision, and human control. However, as this method has become more advanced, it has also led to the creation of DeepFake video sequences and images in which alterations can be made without immediately appealing to the viewer. These technological advancements have introduced new security threats, including in the field of education. For example, in online exams and tests conducted through video conferencing, individuals may use Deepfake technology to impersonate another person, potentially allowing them to cheat by having someone else take the exam in their place. Several detection approaches have been proposed to address these issues, including systems that use both spatial and temporal features. However, existing approaches have limitations regarding detection accuracy and overall effectiveness. The paper proposes a technique for detecting Deepfakes that combines temporal analysis with convolutional neural networks. The study explores various 3-D Convolutional Neural Networks-based (CNN-based) model approaches and different sequence lengths of facial photos. The results indicate that using a 3-D CNN model with 16 sequential face images as input can detect Deepfakes with up to 97.3 percent accuracy on the FaceForensic dataset. Detecting Deepfakes is crucial as they pose a threat to the authenticity of visual media. The proposed technique offers a promising solution to this issue.
引用
收藏
页码:488 / 494
页数:7
相关论文
共 19 条
[1]   Constrained Convolutional Neural Networks: A New Approach Towards General Purpose Image Manipulation Detection [J].
Bayar, Belhassen ;
Stamm, Matthew C. .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2018, 13 (11) :2691-2706
[2]   Video Face Manipulation Detection Through Ensemble of CNNs [J].
Bonettini, Nicolo ;
Cannas, Edoardo Daniele ;
Mandelli, Sara ;
Bondi, Luca ;
Bestagini, Paolo ;
Tubaro, Stefano .
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, :5012-5019
[3]   Learning Spatiotemporal Features with 3D Convolutional Networks [J].
Du Tran ;
Bourdev, Lubomir ;
Fergus, Rob ;
Torresani, Lorenzo ;
Paluri, Manohar .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :4489-4497
[4]  
Duchi J, 2011, J MACH LEARN RES, V12, P2121
[5]  
Dumoulin V, 2018, Arxiv, DOI [arXiv:1603.07285, 10.48550/arXiv.1603.07285, DOI 10.48550/ARXIV.1603.07285]
[6]   Fake face detection via adaptive manipulation traces extraction network [J].
Guo, Zhiqing ;
Yang, Gaobo ;
Chen, Jiyou ;
Sun, Xingming .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 204
[7]  
Ioffe S., 2015, P 32 INT C MACH LEAR, P448
[8]   3D Convolutional Neural Networks for Human Action Recognition [J].
Ji, Shuiwang ;
Xu, Wei ;
Yang, Ming ;
Yu, Kai .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (01) :221-231
[9]  
Kumar P, 2020, IEEE WINT CONF APPL, P2578, DOI [10.1109/WACV45572.2020.9093628, 10.1109/wacv45572.2020.9093628]
[10]  
Li Y., 2019, PROC IEEE INT WORKSH