Classification of Images as Photographs or Paintings by Using Convolutional Neural Networks

被引:2
作者
Miguel Lopez-Rubio, Jose [1 ]
Molina-Cabello, Miguel A. [1 ,2 ]
Ramos-Jimenez, Gonzalo [1 ]
Lopez-Rubio, Ezequiel [1 ,2 ]
机构
[1] Univ Malaga, Dept Comp Languages & Comp Sci, Bulevar Louis Pasteur 35, Malaga 29071, Spain
[2] Inst Invest Biomed Malaga IBIMA, Malaga, Spain
来源
ADVANCES IN COMPUTATIONAL INTELLIGENCE, IWANN 2021, PT I | 2021年 / 12861卷
关键词
Convolutional neural networks; Feature extraction; Image classification; Distinguishing photographs; Paintings; COMPLEXITY;
D O I
10.1007/978-3-030-85030-2_36
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Determining whether an image is a photograph or a painting is an unsolved problem, and it is not trivially or automatically performed by humans. In previous works, humans decided which metrics should be calculated on an image to make a prediction, achieving a maximum precision of 94.82%. In this work, we propose the use of a deep learning convolutional neural network that processes the images directly, without determining the most relevant properties of an image in advance. Different modifications of the VGG network architecture are analyzed. After training the network with 16,000 images and for 100 epochs, an AUC ROC above 0.99 is achieved in images from ImageNet and in the Kaggle Painters by Numbers competition, and 0.942 in the images used by the most recent proposal in the field.
引用
收藏
页码:432 / 442
页数:11
相关论文
共 26 条
[1]  
[Anonymous], 2015, A neural algorithm of artistic style, DOI DOI 10.1167/16.12.326
[2]   Distinguishing photographs and graphics on the World Wide Web [J].
Athitsos, V ;
Swain, MJ ;
Frankel, C .
IEEE WORKSHOP ON CONTENT-BASED ACCESS OF IMAGE AND VIDEO LIBRARIES, PROCEEDINGS, 1997, :10-17
[3]  
Baldassarre F., 2017, ABS171203400 CORR
[4]  
Birkhoff G. D., 1933, AESTHETIC MEASURE
[5]   Distinguishing paintings from photographs by complexity estimates [J].
Carballal, Adrian ;
Santos, Antonino ;
Romero, Juan ;
Machado, Penousal ;
Correia, Joao ;
Castro, Luz .
NEURAL COMPUTING & APPLICATIONS, 2018, 30 (06) :1957-1969
[6]   Distinguishing paintings from photographs [J].
Cutzu, F ;
Hammoud, R ;
Leykin, A .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2005, 100 (03) :249-273
[7]  
Cutzu F, 2003, PROC CVPR IEEE, P305
[8]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[9]   Predicting beauty: Fractal dimension and visual complexity in art [J].
Forsythe, A. ;
Nadal, M. ;
Sheehy, N. ;
Cela-Conde, C. J. ;
Sawey, M. .
BRITISH JOURNAL OF PSYCHOLOGY, 2011, 102 :49-70
[10]   Fine-tuning deep convolutional neural networks for distinguishing illustrations from photographs [J].
Gando, Gota ;
Yamada, Taiga ;
Sato, Haruhiko ;
Oyama, Satoshi ;
Kurihara, Masahito .
EXPERT SYSTEMS WITH APPLICATIONS, 2016, 66 :295-301