Dual-Task Cascaded for Proactive Deepfake Detection Using QPCET Watermarking

被引:0
作者
Wang, Chunpeng [1 ,2 ]
Shi, Chaoyi [1 ,2 ]
Liu, Yunan [1 ,3 ]
Xia, Zhiqiu [1 ,2 ]
Li, Jian [1 ,2 ]
Xian, Yongjin [1 ,2 ]
Ma, Bin [1 ,2 ]
机构
[1] Qilu Univ Technol, Shandong Comp Sci Ctr, Key Lab Comp Power Network & Informat Secur, Minist Educ,Shandong Acad Sci, Jinan, Peoples R China
[2] Shandong Fundamental Res Ctr Comp Sci, Shandong Prov Key Lab Comp Networks, Jinan, Peoples R China
[3] Dalian Maritime Univ, Sch Artificial Intelligence, Dalian 116024, Peoples R China
来源
PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT II | 2025年 / 15032卷
基金
中国国家自然科学基金;
关键词
Proactive deepfake detection; Dual-task cascaded detection; Quaternion Polar Complex Exponential Transform; Robust watermarking;
D O I
10.1007/978-981-97-8490-5_10
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, the rapid development of deepfake technology has brought serious threats to facial information security. To address this issue, numerous passive deepfake detection methods have been developed with notable success. However, these methods are limited in offering proactive defense against deepfakes. To this end, we propose a proactive deepfake detection framework that integrates Quaternion Polar Complex Exponential Transform (QPCET) with deep learning, treating watermark embedding and extraction as two separate processes. Firstly, we embed the watermark information into QPCET coefficients, enhancing the robustness of the watermark against conventional attacks while ensuring its imperceptibility. Secondly, we propose a Dual-Task Cascaded Detection (DTCD) framework for watermark extraction and deepfake detection. Additionally, we introduce a Self-Attention Moment-Aware Watermark Detection (SAM-WD) module, which aids the model in more accurately perceiving watermark embedding regions. Through knowledge distillation between the two tasks, the model can accurately extract watermarks under conventional attacks and accurately detect deepfake. Experimental results on benchmark datasets demonstrate that our method surpasses state-of-the-art techniques, delivering exceptional performance in watermark robustness and imperceptibility while simultaneously accomplishing accurate deepfake detection.
引用
收藏
页码:132 / 147
页数:16
相关论文
共 43 条
  • [1] TAFIM: Targeted Adversarial Attacks Against Facial Image Manipulations
    Aneja, Shivangi
    Markhasin, Lev
    Niessner, Matthias
    [J]. COMPUTER VISION - ECCV 2022, PT XIV, 2022, 13674 : 58 - 75
  • [2] WaterLo: Protect Images from Deepfakes Using Localized Semi-Fragile Watermark
    Beuve, Nicolas
    Hamidouche, Wassim
    Deforges, Olivier
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 393 - 402
  • [3] Video Face Manipulation Detection Through Ensemble of CNNs
    Bonettini, Nicolo
    Cannas, Edoardo Daniele
    Mandelli, Sara
    Bondi, Luca
    Bestagini, Paolo
    Tubaro, Stefano
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 5012 - 5019
  • [4] Chai Lucy, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12371), P103, DOI 10.1007/978-3-030-58574-7_7
  • [5] Chen Lisha, 2022, NeurIPS
  • [6] SimSwap: An Efficient Framework For High Fidelity Face Swapping
    Chen, Renwang
    Chen, Xuanhong
    Ni, Bingbing
    Ge, Yanhao
    [J]. MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 2003 - 2011
  • [7] Dong SC, 2022, LECT NOTES COMPUT SC, V13674, P18, DOI 10.1007/978-3-031-19781-9_2
  • [8] Speech Driven Talking Face Generation From a Single Image and an Emotion Condition
    Eskimez, Sefik Emre
    Zhang, You
    Duan, Zhiyao
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 24 : 3480 - 3490
  • [9] Gu ZH, 2022, PROCEEDINGS OF THE THIRTY-FIRST INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2022, P920
  • [10] Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detection
    Haliassos, Alexandros
    Vougioukas, Konstantinos
    Petridis, Stavros
    Pantic, Maja
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 5037 - 5047