MODEL ATTRIBUTION OF FACE-SWAP DEEPFAKE VIDEOS

被引:6
作者
Jia, Shan [1 ]
Li, Xin [2 ]
Lyu, Siwei [1 ]
机构
[1] SUNY Buffalo, Buffalo, NY 14260 USA
[2] West Virginia Univ, Morgantown, WV USA
来源
2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP | 2022年
关键词
Face-swap Deepfakes; Model Attribution; Deepfakes Generation;
D O I
10.1109/ICIP46576.2022.9897972
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
AI-created face-swap videos, commonly known as Deepfakes, have attracted wide attention as powerful impersonation attacks. Existing research on Deepfakes mostly focuses on binary detection to distinguish between real and fake videos. However, it is also important to determine the specific generation model for a fake video, which can help attribute it to the source for forensic investigation. In this paper, we fill this gap by studying the model attribution problem of Deepfake videos. We first introduce a new dataset with DeepFakes from Different Models (DFDM) based on several Autoencoder models. Specifically, five generation models with variations in encoder, decoder, intermediate layer, input resolution, and compression ratio have been used to generate a total of 6, 450 Deepfake videos based on the same input. Then we take Deepfakes model attribution as a multiclass classification task and propose a spatial and temporal attention based method to explore the differences among Deepfakes in the new dataset. Experimental evaluation shows that most existing Deepfakes detection methods failed in Deepfakes model attribution, while the proposed method achieved over 70% accuracy on the high-quality DFDM dataset(1).
引用
收藏
页码:2356 / 2360
页数:5
相关论文
共 34 条
  • [1] Afchar D, 2018, IEEE INT WORKS INFOR
  • [2] Asnani Vishal, 2021, ARXIV210607873
  • [3] Bitton J., 2020, The DeepFake Detection Challenge (DFDC) Dataset
  • [4] Video Face Manipulation Detection Through Ensemble of CNNs
    Bonettini, Nicolo
    Cannas, Edoardo Daniele
    Mandelli, Sara
    Bondi, Luca
    Bestagini, Paolo
    Tubaro, Stefano
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 5012 - 5019
  • [5] How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)
    Bulat, Adrian
    Tzimiropoulos, Georgios
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 1021 - 1030
  • [6] Deep Fakes: A Looming Challenge for Privacy, Democracy, and National Security
    Chesney, Bobby
    Citron, Danielle
    [J]. CALIFORNIA LAW REVIEW, 2019, 107 (06) : 1753 - 1819
  • [7] de Lima Oscar, 2020, ARXIV200614749
  • [8] Dolhansky Brian, 2019, The Deepfake Detection Challenge (DFDC) Preview Dataset
  • [9] Dufour N., 2019, Google AI Blog, V1, P3
  • [10] Durall Ricard, 2019, Unmasking DeepFakes with simple Features