Exposing Computer Generated Images by Eye's Region Classification via Transfer Learning of VGG19 CNN

被引:67
作者
Carvalho, Tiago [1 ]
de Rezende, Edmar R. S. [2 ]
Alves, Matheus T. P. [1 ]
Balieiro, Fernanda K. C. [1 ]
Sovat, Ricardo B. [1 ]
机构
[1] Fed Inst Sao Paulo IFSP, BR-13069901 Campinas, SP, Brazil
[2] CTI Renato Archer, BR-13069901 Campinas, SP, Brazil
来源
2017 16TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA) | 2017年
基金
巴西圣保罗研究基金会;
关键词
D O I
10.1109/ICMLA.2017.00-47
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The advance of computer graphics techniques comes revolutionizing games and movie's industries. Creating very realistic characters totally from computer graphics models is, nowadays, a reality. However, this advance comes with a big price: the realism of images is so big that it is difficult to realize when we are facing a computer generated image or a real photo. In this paper we propose a new approach for highly realistic computer generated images detection by exploring inconsistencies into the region of the eyes. Such inconsistencies are captured exploring the expression power of features extracted via transfer learning approach with VGG19 Deep Neural Network model. Unlike the state-of-the-art approaches, which looks to evaluate the entire image, proposed method focuses in specific regions (eyes) where computer graphics modeling still needs improvements. Experiments conducted over two different datasets containing extremely realistic images achieved an accuracy of 0.80 and an AUC of 0.88.
引用
收藏
页码:866 / 870
页数:5
相关论文
共 16 条
  • [1] [Anonymous], ACM TAP
  • [2] Bishop C.M., 2006, PATTERN RECOGN, V4, P738, DOI DOI 10.1117/1.2819119
  • [3] Illuminant-Based Transformed Spaces for Image Forensics
    Carvalho, Tiago
    Faria, Fabio A.
    Pedrini, Helio
    Torres, Ricardo da S.
    Rocha, Anderson
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2016, 11 (04) : 720 - 733
  • [4] Conotter V, 2014, IEEE IMAGE PROC, P248, DOI 10.1109/ICIP.2014.7025049
  • [5] A framework for selection and fusion of pattern classifiers in multimedia recognition
    Faria, Fabio A.
    dos Santos, Jefersson A.
    Rocha, Anderson
    Torres, Ricardo da S.
    [J]. PATTERN RECOGNITION LETTERS, 2014, 39 : 52 - 64
  • [6] Farid H., 2004, TR2004518
  • [7] Data-Driven Feature Characterization Techniques for Laser Printer Attribution
    Ferreira, Anselmo
    Bondi, Luca
    Baroffio, Luca
    Bestagini, Paolo
    Huang, Jiwu
    dos Santos, Jefersson A.
    Tubaro, Stefano
    Rocha, Anderson
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2017, 12 (08) : 1860 - 1873
  • [8] Johnson M., 2007, IHW
  • [9] Nair V., 2010, PROC INT C MACH LEAR, P807, DOI DOI 10.5555/3104322.3104425
  • [10] Eyes for relighting
    Nishino, K
    Nayar, SK
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2004, 23 (03): : 704 - 711