A Comparative Analysis of Deepfake Detection Methods Using Overlapping Multiple Dynamic Images

被引:0
作者
Purevsuren, Enkhtaivan [1 ]
Sato, Junya [2 ]
Akashi, Takuya [3 ]
机构
[1] Iwate Univ, Grad Sch Engn, Dept Design & Media Technol, 4-3-5 Ueda, Morioka, Iwate 0208551, Japan
[2] Gifu Univ, Fac Engn, 1-1 Yanagido, Gifushi, Gifu 5011193, Japan
[3] Okayama Univ, Dept Informat Elect Mathemat Data Sci Informat, Facil Engn, 3-1-1 Tsushima Naka,Kita Ku, Okayama 7008530, Japan
关键词
fake face; deepfake; the overlapping multiple dynamic images;
D O I
10.1002/tee.24258
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Deepfake technology, which uses artificial intelligence to create realistic fake images, audio, and videos, has raised significant concerns due to its potential for misuse and manipulation. The emergence of deepfake technology poses a significant threat to the integrity of digital content, necessitating robust detection mechanisms. This paper proposes a novel method for deepfake detection by combining Overlapping Multiple Dynamic Images (OMDI) and Inversed Overlapping Multiple Dynamic Images (I-OMDI). Both representations capture temporal inconsistencies and subtle visual artifacts in fake videos by effectively utilizing spatial-temporal information. Our approach employs EfficientNetB7 as the backbone for feature extraction, enabling the model to distinguish between real and fake videos with high accuracy. By combining OMDI and I-OMDI with a weighted average strategy, we amplify the strengths of each method. Specifically, we assign equal weights of 0.5 to OMDI and I-OMDI based on their individual contributions to performance metrics. This balance yields substantial performance improvements across multiple datasets. When evaluated on the Celeb-DF v2 and DFDC datasets, our proposed model achieves state-of-the-art results, with an AUC score of 0.9952 on Celeb-DF v2 and 0.9947 on DFDC. These results underscore the robustness of the combined OMDI and I-OMDI methods in identifying deepfake videos. Furthermore, our model demonstrates superior performance compared to existing methods, including those by Tran et al. and Heo et al., underscoring its effectiveness in practical deepfake detection applications. (c) 2025 Institute of Electrical Engineers of Japan and Wiley Periodicals LLC.
引用
收藏
页数:13
相关论文
共 49 条
  • [1] [Anonymous], Stochastic gradient vb and the variational autoencoder. Second International Conference on Learning Representations, ICLR, 19
  • [2] [Anonymous], 1997, Youtube: Youtube
  • [3] Bailey M., Adobe photoshop: A beginners guide to photoshop lightroomthe 52 photoshop lightroom tricks you didn't know existed. CreateSpace Independent Publishing Platform
  • [4] Action Recognition with Dynamic Image Networks
    Bilen, Hakan
    Fernando, Basura
    Gavves, Efstratios
    Vedaldi, Andrea
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (12) : 2799 - 2813
  • [5] Bitouk D., Face swapping: Automatically replacing faces in photographs. ACM SIGGRAPH 2008 papers
  • [6] The use of the area under the roc curve in the evaluation of machine learning algorithms
    Bradley, AP
    [J]. PATTERN RECOGNITION, 1997, 30 (07) : 1145 - 1159
  • [7] Chen HS., Defakehop: A lightweight highperformance deepfake detector. 2021 IEEE International Conference on Multimedia and Expo (ICME)
  • [8] Chollet F., XCEPTION DEEP LEARNI
  • [9] Dale K., Video face replacement. Proceedings of the 2011 SIGGRAPH Asia Conference
  • [10] Das S., Towards solving the deepfake problem: An analysis on improving deepfake detection using dynamic face augmentation. Proceedings of the IEEE/CVF International Conference on Computer Vision