Unsupervised Generative Fake Image Detector

被引:6
作者
Qiao, Tong [1 ,2 ]
Shao, Hang [1 ]
Xie, Shichuang [1 ]
Shi, Ran [3 ]
机构
[1] Hangzhou Dianzi Univ, Sch Cyberspace, Hangzhou 310018, Peoples R China
[2] Zhejiang Prov, Sino France Joint Lab Digital Media Forens, Hangzhou 310018, Peoples R China
[3] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
关键词
Image forensics; unsupervised learning; generative fake images;
D O I
10.1109/TCSVT.2024.3383833
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recently, the rapid advancement of generative model has led to its exploitation by malicious actors who employ it to fabricate fake synthetic images. Meanwhile, the deceptive images are often disseminated on social network platforms, thereby undermining public trust. Although reliable forensic tools have emerged to detect generative fake images, the existing supervised detectors excessively rely on the correctly-labeled training samples, leading to overwhelming outsourcing annotation costs and the potential risk of suffering from label flipping attack. In light of the aforementioned limitations, we propose an unsupervised detector fighting against generative fake image. In particular, we assign the noisy labels to the training samples. Then dependent on the pre-clustered samples with noisy labels, the strategy of pre-training and re-training mechanism helps us train the feature extractor utilized to extract the discriminative feature. Last, the extracted feature guides us to respectively cluster both pristine and fake images; the fake images are effectively filtered by employing cosine similarity. Extensive experimental results highlight that our unsupervised detector rivals the baseline supervised methods; moreover, it has better capability of defending against label flipping attack.
引用
收藏
页码:8442 / 8455
页数:14
相关论文
共 71 条
[1]   A Novel Neural Model based Framework for Detection of GAN Generated Fake Images [J].
Agarwal, Samaksh ;
Girdhar, Nancy ;
Raghav, Himamshu .
2021 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, DATA SCIENCE & ENGINEERING (CONFLUENCE 2021), 2021, :46-51
[2]  
[Anonymous], 2023, Imagen2
[3]  
Arkhipkin V, 2024, Arxiv, DOI arXiv:2312.03511
[4]   CNN Detection of GAN-Generated Face Images based on Cross-Band Co-occurrences Analysis [J].
Barni, Mauro ;
Kailas, Kassem ;
Nowroozi, Ehsan ;
Tondi, Benedetta .
2020 IEEE INTERNATIONAL WORKSHOP ON INFORMATION FORENSICS AND SECURITY (WIFS), 2020,
[5]   On the use of Benford's law to detect GAN-generated images [J].
Bonettini, Nicolo ;
Bestagini, Paolo ;
Milani, Simone ;
Tubaro, Stefano .
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, :5495-5502
[6]  
Brock A, 2019, Arxiv, DOI arXiv:1809.11096
[7]   A Robust GAN-Generated Face Detection Method Based on Dual-Color Spaces and an Improved Xception [J].
Chen, Beijing ;
Liu, Xin ;
Zheng, Yuhui ;
Zhao, Guoying ;
Shi, Yun-Qing .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (06) :3527-3538
[8]   Distinguishing Between Natural and GAN-Generated Face Images by Combining Global and Local Features [J].
Chen Beijing ;
Tan Weijin ;
Wang Yiting ;
Zhao Guoying .
CHINESE JOURNAL OF ELECTRONICS, 2022, 31 (01) :59-67
[9]   StarGAN v2: Diverse Image Synthesis for Multiple Domains [J].
Choi, Yunjey ;
Uh, Youngjung ;
Yoo, Jaejun ;
Ha, Jung-Woo .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :8185-8194
[10]   StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation [J].
Choi, Yunjey ;
Choi, Minje ;
Kim, Munyoung ;
Ha, Jung-Woo ;
Kim, Sunghun ;
Choo, Jaegul .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8789-8797