Generalization of Forgery Detection With Meta Deepfake Detection Model

被引:3
|
作者
Tran, Van-Nhan [1 ]
Kwon, Seong-Geun [2 ]
Lee, Suk-Hwan [3 ]
Le, Hoanh-Su [4 ]
Kwon, Ki-Ryong [1 ]
机构
[1] Pukyong Natl Univ, Dept Artificial Intelligence Convergence, Busan 48513, South Korea
[2] Kyungil Univ, Dept Elect Engn, Gyongsan 38428, South Korea
[3] Dong A Univ, Dept Comp Engn, Busan 49315, South Korea
[4] Vietnam Natl Univ Ho Chi Minh City, Univ Econ & Law, Fac Informat Syst, Ho Chi Minh 700000, Vietnam
基金
新加坡国家研究基金会;
关键词
Deepfake detection; meta-learning; artificial intelligence; computer vision;
D O I
10.1109/ACCESS.2022.3232290
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Face forgery generating algorithms that produce a range of manipulated videos/images have developed quickly. Consequently, this causes an increase in the production of fake information, making it difficult to identify. Because facial manipulation technologies raise severe concerns, face forgery detection is gaining increasing attention in the area of computer vision. In real-world applications, face forgery detection systems frequently encounter and perform poorly in unseen domains, due to poor generalization. In this paper, we propose a deepfake detection method based on meta-learning called Meta Deepfake Detection (MDD). The goal of the model is to develop a generalized model capable of directly solving new unseen domains without the need for model updates. The MDD algorithm establishes various weights for facial images from various domains. Specifically, MDD uses meta-weight learning to shift information from the source domains to the target domains with meta-optimization steps, which aims for the model to generate effective representations of the source and target domains. We build multi-domain sets using meta splitting strategy to create a meta-train set and meta-test set. Based on these sets, the model determines the gradient descent and obtains backpropagation. The inner and outer loop gradients were aggregated to update the model to enhance generalization. By introducing pair-attention loss and average-center alignment loss, the detection capabilities of the system were substantially enhanced. In addition, we used some evaluation benchmarks established from several popular deepfake datasets to compare the generalization of our proposal in several baselines and assess its effectiveness.
引用
收藏
页码:535 / 546
页数:12
相关论文
共 50 条
  • [1] Learning Face Forgery Detection in Unseen Domain with Generalization Deepfake Detector
    Tran, Van-Nhan
    Lee, Suk-Hwan
    Le, Hoanh-Su
    Kim, Bo-Sung
    Kwon, Ki-Ryong
    2023 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS, ICCE, 2023,
  • [2] A Survey on Face Forgery Detection of Deepfake
    Zhang, Ying
    Gao, Feng
    Zhou, Zichen
    Guo, Hong
    THIRTEENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2021), 2021, 11878
  • [3] Towards Generalization in Deepfake Detection
    Verdoliva, Luisa
    PROCEEDINGS OF THE 2022 ACM WORKSHOP ON INFORMATION HIDING AND MULTIMEDIA SECURITY, IH-MMSEC 2022, 2022, : 1 - 1
  • [4] Towards Generalization in Deepfake Detection
    Verdoliva, Luisa
    1ST ACM INTERNATIONAL WORKSHOP ON MULTIMEDIA AI AGAINST DISINFORMATION, MAD 2022, 2022, : 1 - 1
  • [5] FORGERY DETECTION OF LOW QUALITY DEEPFAKE VIDEOS
    Sohaib, M.
    Tehseen, S.
    NEURAL NETWORK WORLD, 2023, 33 (02) : 85 - 99
  • [6] Magnifying multimodal forgery clues for Deepfake detection
    Liu, Xiaolong
    Yu, Yang
    Li, Xiaolong
    Zhao, Yao
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 118
  • [7] Common Forgery Artifact Driven Deepfake Face Detection
    Wu, Haotian
    Wang, Xin
    Wang, Ruobing
    Xiang, Ji
    Ren, Liyue
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 1585 - 1590
  • [8] Improving Generalization of Deepfake Detection by Training for Attribution
    Jain, Anubhav
    Korshunov, Pavel
    Marcel, Sebastien
    IEEE MMSP 2021: 2021 IEEE 23RD INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2021,
  • [9] CDNET: CLUSTER DECISION FOR DEEPFAKE DETECTION GENERALIZATION
    Hou, Zeming
    Hua, Zhongyun
    Zhang, Kuiyuan
    Zhang, Yushu
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3010 - 3014
  • [10] Exposing the Deception: Uncovering More Forgery Clues for Deepfake Detection
    Ba, Zhongjie
    Liu, Qingyu
    Liu, Zhenguang
    Wu, Shuang
    Lin, Feng
    Lu, Li
    Ren, Kui
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2, 2024, : 719 - 728