Guardian-AI: A novel deep learning based deepfake detection model in images

被引:0
作者
Alsolai, Hadeel [1 ]
Mahmood, Khalid [2 ]
Alshuhail, Asma [3 ]
Ben Miled, Achraf [4 ]
Alqahtani, Mohammed [5 ]
Alshareef, Abdulrhman [6 ]
Alallah, Fouad Shoie [6 ]
Alghamdi, Bandar M. [7 ]
机构
[1] Princess Nourah Bint Abdulrahman Univ, Coll Comp & Informat Sci, Dept Informat Syst, POB 84428, Riyadh 11671, Saudi Arabia
[2] King Khalid Univ, Appl Coll Mahayil, Dept Informat Syst, Abha, Saudi Arabia
[3] King Faisal Univ, Coll Comp Sci & Informat Technol, Dept Informat Syst, Al Hufuf, Saudi Arabia
[4] Northern Border Univ Arar, Coll Sci, Dept Comp Sci, Ar Ar 73213, Saudi Arabia
[5] Univ Bisha, Coll Comp & Informat Technol, Dept Informat Syst & Cyber Secur, Bisha 61922, Saudi Arabia
[6] King Abdulaziz Univ, Fac Comp & Informat Technol, Dept Informat Syst, Jeddah, Saudi Arabia
[7] King Abdulaziz Univ, Fac Comp & Informat Technol, Dept Informat Technol, Jeddah 21589, Saudi Arabia
关键词
Deep learning; Deepfake; CDDB; ViT transformer; Attention mechanism;
D O I
10.1016/j.aej.2025.04.095
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The rapid advancement of deepfake technology has introduced significant challenges and opportunities across various domains. This article proposes a robust deepfake detection pipeline utilising a combination of attention mechanisms, pre-trained Vision Transformers (ViTs), and Long Short-Term Memory (LSTM) networks. The initial phase of the pipeline involves preparing photos and videos, potentially using optional facial detection to enhance accuracy. Vision Transformers derive features by capturing the global dependencies of input data. Long shortterm memory (LSTM) networks address inter-frame temporal dependencies, whereas multi-head and traditional attention processes focus on essential elements. Ultimately, fully connected layers are employed for classification within the ensemble architecture, which consolidates the outcomes of several models. To ensure generalisability, assessment and regularisation approaches are employed to train the model using labelled datasets. Given the escalating threat of deepfakes, the findings indicate that the pipeline can consistently distinguish between genuine and fabricated information.
引用
收藏
页码:507 / 514
页数:8
相关论文
共 28 条
[1]   Who inadvertently shares deepfakes? Analyzing the role of political interest, cognitive ability, and social network size [J].
Ahmed, Saifuddin .
TELEMATICS AND INFORMATICS, 2021, 57
[2]  
Chen HS, 2021, Arxiv, DOI arXiv:2103.06929
[3]  
Chen L., Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detection
[4]  
Cozzolino D., ID-Reveal: Identity-aware DeepFake Video Detection
[5]  
Das S., Towards Solving the DeepFake Problem: An Analysis on Improving DeepFake Detection using Dynamic Face Augmentation
[6]  
Dolhansky B., The DeepFake Detection Challenge (DFDC) Dataset
[7]  
Dong S., Explaining Deepfake Detection by Analysing Image Matching
[8]   DFT-MF: Enhanced deepfake detection using mouth movement and transfer learning [J].
Elhassan, Ammar ;
Al-Fawa'reh, Mohammad ;
Jafar, Mousa Tayseer ;
Ababneh, Mohammad ;
Jafar, Shifaa Tayseer .
SOFTWAREX, 2022, 19
[9]  
Goodfellow IJ, 2014, arXiv, DOI [DOI 10.48550/ARXIV.1406.2661, 10.48550/ARXIV.1406.2661]
[10]  
Haque S, 2022, INT C PROGRAM COMPRE, P36, DOI 10.1145/nnnnnnn.nnnnnnn