CNN Detection of GAN-Generated Face Images based on Cross-Band Co-occurrences Analysis

被引:33
作者
Barni, Mauro [1 ]
Kailas, Kassem [1 ]
Nowroozi, Ehsan [1 ]
Tondi, Benedetta [1 ]
机构
[1] Univ Siena, Dept Informat Engn, Via Roma 56, I-53100 Siena, Italy
来源
2020 IEEE INTERNATIONAL WORKSHOP ON INFORMATION FORENSICS AND SECURITY (WIFS) | 2020年
关键词
D O I
10.1109/WIFS49906.2020.9360905
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Last-generation GAN models allow to generate synthetic images which are visually indistinguishable from natural ones, raising the need to develop tools to distinguish fake and natural images thus contributing to preserve the trustworthiness of digital images. While modern GAN models can generate very high-quality images with no visible spatial artifacts, reconstruction of consistent relationships among colour channels is expectedly more difficult. In this paper, we propose a method for distinguishing GAN-generated from natural images by exploiting inconsistencies among spectral bands, with specific focus on the generation of synthetic face images. Specifically, we use cross-band co-occurrence matrices, in addition to spatial co-occurrence matrices, as input to a CNN model, which is trained to distinguish between real and synthetic faces. The results of our experiments confirm the goodness of our approach which outperforms a similar detection technique based on intra-band spatial co-occurrences only. The performance gain is particularly significant with regard to robustness against post-processing, like geometric transformations, filtering and contrast manipulations.
引用
收藏
页数:6
相关论文
共 26 条
[1]  
Agarwal S, 2018, 2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), P1997, DOI 10.1109/ICASSP.2018.8462205
[2]  
[Anonymous], 2018, P INT C LEARN REPR V
[3]  
[Anonymous], 2017, ARXIV160904747
[4]  
[Anonymous], 1994, Graphics Gems, DOI DOI 10.1016/B978-0-12-336156-1.50040-9
[5]  
Barni M, 2017, EUR SIGNAL PR CONF, P281, DOI 10.23919/EUSIPCO.2017.8081213
[6]  
Barni Mauro., 2018, 2018 INT WORKSHOP BI, P1, DOI DOI 10.1109/IWBF.2018.8401564
[7]   FlyMap: Interacting with Maps Projected from a Drone [J].
Brock, Anke M. ;
Chatain, Julia ;
Park, Michelle ;
Fang, Tommy ;
Hachet, Martin ;
Landay, James A. ;
Cauchard, Jessica R. .
PROCEEDINGS PERVASIVE DISPLAYS 2018: THE 7TH ACM INTERNATIONAL SYMPOSIUM ON PERVASIVE DISPLAYS, 2018,
[8]   StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation [J].
Choi, Yunjey ;
Choi, Minje ;
Kim, Munyoung ;
Ha, Jung-Woo ;
Kim, Sunghun ;
Choo, Jaegul .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8789-8797
[9]   Recasting Residual-based Local Descriptors as Convolutional Neural Networks: an Application to Image Forgery Detection [J].
Cozzolino, Davide ;
Poggi, Giovanni ;
Verdoliva, Luisa .
IH&MMSEC'17: PROCEEDINGS OF THE 2017 ACM WORKSHOP ON INFORMATION HIDING AND MULTIMEDIA SECURITY, 2017, :159-164
[10]  
Cozzolino D, 2014, IEEE IMAGE PROC, P5297, DOI 10.1109/ICIP.2014.7026072