Fundamental visual features for aesthetic classification of photographs across datasets

被引:12
作者
Lemarchand, Francois [1 ]
机构
[1] Plymouth Univ, Dept Comp Elect & Math, Link 3, Plymouth PL4 8AA, Devon, England
关键词
Feature extraction; Aesthetic classification; Visual preferences; Deep learning; Neuroaesthetics; PREFERENCE; PERCEPTION;
D O I
10.1016/j.patrec.2018.05.016
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The recent and exponential increase of online photographs is catalysing the development of artificial intelligence systems that evaluate images on their aesthetics in order to filter out photos and provide users with more pleasing content. This paper proposes a new approach inspired by findings in psychophysics and neuroscience, to build a cross-dataset aesthetic classifier which learns by extracting an efficient set of features from images. Inspired from low-level features present in the human early visual process, the artificial intelligent system extracts percentage distributions for orientation, curvature, colour and global reflectional symmetry. Knowing only people's aesthetic judgments on images, the features are then fed to a deep neural network under the form of only 114 inputs. Once trained, the proposed system was successful in classifying unseen images depending on their aesthetics to state-of-the-art level, even on datasets different from the initial training dataset. Analysis of differences in extracted features between aesthetically good and poor images highlights previously observed human aesthetic preferences in static two-dimensional scenes, such as preference for the colour blue or horizontal lines. By learning from brain-inspired features, it is hoped to allow a knowledge transfer of aesthetic expertise in photographs towards other types of visual media (paintings, movies, etc.). (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:9 / 17
页数:9
相关论文
共 41 条
[1]  
Abadi M., 2015, PREPRINT
[2]  
[Anonymous], 2016, ARXIV160404970
[3]  
[Anonymous], 2016, ARXIV160104155
[4]  
Ball V.K., 1965, J AESTHET ART CRITIC, V23, P441, DOI DOI 10.1111/1540_6245.JAAC23.4.0441
[5]   Visual elements of subjective preference modulate amygdala activation [J].
Bar, Moshe ;
Neta, Maital .
NEUROPSYCHOLOGIA, 2007, 45 (10) :2191-2200
[6]   Do observers like curvature or do they dislike angularity? [J].
Bertamini, Marco ;
Palumbo, Letizia ;
Gheorghes, Tamara Nicoleta ;
Galatsidas, Mai .
BRITISH JOURNAL OF PSYCHOLOGY, 2016, 107 (01) :154-178
[7]   ORIENTATION SELECTIVITY, PREFERENCE, AND CONTINUITY IN MONKEY STRIATE CORTEX [J].
BLASDEL, GG .
JOURNAL OF NEUROSCIENCE, 1992, 12 (08) :3139-3161
[8]   Overrepresentation of horizontal and vertical orientation preferences in developing ferret area 17 [J].
Chapman, B ;
Bonhoeffer, T .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 1998, 95 (05) :2609-2614
[9]   Histograms of oriented gradients for human detection [J].
Dalal, N ;
Triggs, B .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :886-893
[10]  
Datta R, 2006, LECT NOTES COMPUT SC, V3953, P288, DOI 10.1007/11744078_23