ID-insensitive deepfake detection model based on multi-attention mechanism

被引:0
|
作者
Sheng, Yuncan [4 ]
Zou, Zhengrui [1 ]
Yu, Zongxuan [1 ]
Pang, Mengxue [1 ]
Ou, Wei [1 ,2 ,3 ]
Han, Wenbao [1 ]
机构
[1] Hainan Univ, Sch Cyberspace Secur, Sch Cryptol, Haikou 570228, Peoples R China
[2] Lab Adv Comp & Intelligence Engn, Wuxi 214100, Peoples R China
[3] Jiangsu Variable Supercomp Technol Co Ltd, Wuxi 214100, Peoples R China
[4] Hainan Univ, Sch Informat & Commun Engn, Haikou 570228, Peoples R China
来源
SCIENTIFIC REPORTS | 2025年 / 15卷 / 01期
基金
中国国家自然科学基金;
关键词
Deepfake detection; Multi-scale artifact detection; Attention map; Texture feature enhancement;
D O I
10.1038/s41598-025-96254-6
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Deepfake technology has enabled the widespread distribution of manipulated facial content online, raising serious societal concerns. In recent years, deepfake detection has emerged as a critical research focus. However, existing methods frequently overlook the connection between local details and overall image features, while also failing to address the problem of implicit identity leakage. Consequently, their performance is suboptimal, particularly in cross-dataset evaluations. Specifically, the proposed multi-attention deepfake detection model consists of the following three parts: (1) Texture Feature Enhancement: We employ CondenseNet to enhance texture features efficiently, preserving subtle details and ensuring feature integrity; (2) Multi-Scale Artifact Detection: We introduce an artifact detection module that identifies potentially manipulated regions, enabling localized detection and minimizing the impact of identity information. (3) Multi-Attention Mechanism: By generating multiple attention maps, our model prioritizes different regions of the input image, fusing both texture and local features to improve classification performance. Our method is evaluated on the FaceForensics++ and DFDC benchmarks for facial manipulation detection. Additionally, we assess its cross-dataset performance on Celeb-DF-v2, achieving state-of-the-art results.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Multi-Attention Network for Sewage Treatment Plant Detection
    Shuai, Yue
    Xie, Jun
    Lu, Kaixuan
    Chen, Zhengchao
    SUSTAINABILITY, 2023, 15 (07)
  • [32] Multi-attention embedded network for salient object detection
    He, Wei
    Pan, Chen
    Xu, Wenlong
    Zhang, Ning
    SOFT COMPUTING, 2021, 25 (20) : 13053 - 13067
  • [33] MULTI-ATTENTION GHOSTNET FOR DEFORESTATION DETECTION IN THE AMAZON RAINFOREST
    Adarme, M. X. Ortega
    Costa, G. A. O. P.
    Feitosa, R. Q.
    XXIV ISPRS CONGRESS: IMAGING TODAY, FORESEEING TOMORROW, COMMISSION III, 2022, 5-3 : 657 - 664
  • [34] MultiANet: a Multi-Attention Network for Defocus Blur Detection
    Jiang, Zeyu
    Xu, Xun
    Zhang, Chao
    Zhu, Ce
    2020 IEEE 22ND INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2020,
  • [35] Category-Level Multi-Attention based Boundary Refinement for Action Detection
    Dong, Peixiang
    Zhu, Lisong
    Zhang, Yong
    2019 IEEE 4TH INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING (ICSIP 2019), 2019, : 230 - 234
  • [36] Feature Fusion Text Classification Model Combining CNN and BiGRU with Multi-Attention Mechanism
    Zhang, Jingren
    Liu, Fang'ai
    Xu, Weizhi
    Yu, Hui
    FUTURE INTERNET, 2019, 11 (11):
  • [37] A novel multi-scale convolution model based on multi-dilation rates and multi-attention mechanism for mechanical fault diagnosis
    Chu, Caiyuan
    Ge, Yongxin
    Qian, Quan
    Hua, Boyu
    Guo, Jie
    DIGITAL SIGNAL PROCESSING, 2022, 122
  • [38] A Multi-Attention Autoencoder for Hyperspectral Unmixing Based on the Extended Linear Mixing Model
    Su, Lijuan
    Liu, Jun
    Yuan, Yan
    Chen, Qiyue
    REMOTE SENSING, 2023, 15 (11)
  • [39] Visual Sentiment Prediction with Attribute Augmentation and Multi-attention Mechanism
    Zhuanghui Wu
    Min Meng
    Jigang Wu
    Neural Processing Letters, 2020, 51 : 2403 - 2416
  • [40] Comparative Convolutional Dynamic Multi-Attention Recommendation Model
    Ni, Juan
    Huang, Zhenhua
    Yu, Chang
    Lv, Dongdong
    Wang, Cheng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (08) : 3510 - 3521