Analysis of Deep Features for Image Aesthetic Assessment

被引:13
作者
Jang, Hyeongnam [1 ]
Lee, Jong-Seok [1 ]
机构
[1] Yonsei Univ, Sch Integrated Technol, Incheon 21983, South Korea
关键词
Analytical models; Task analysis; Standards; Transfer learning; Predictive models; Training; Deep learning; aesthetic classification; subjectivity;
D O I
10.1109/ACCESS.2021.3060171
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The performance of image aesthetic assessment has been significantly improved by deep learning techniques in comparison to traditional hand-crafted feature-based methods. However, there has not been an attempt to analyze the learned features in deep learning approaches. This paper presents in-depth analysis of the deep models and the learned features by the models for image aesthetic assessment in various viewpoints. We consider binary classification of the mean (average aesthetic level) and standard deviation (subjectivity of aesthetic perception) of aesthetic ratings. In particular, our analysis is based on transfer learning among image classification and aesthetic classifications for comparative analysis. Our results highlight the similarity and transferability of learned features among the classification tasks, and comparison of the trained models and convolutional filters.
引用
收藏
页码:29850 / 29861
页数:12
相关论文
共 31 条
[1]   Autonomous concrete crack detection using deep fully convolutional neural network [J].
Cao Vu Dung ;
Le Duc Anh .
AUTOMATION IN CONSTRUCTION, 2019, 99 :52-58
[2]   Image Aesthetic Assessment An experimental survey [J].
Deng, Yubin ;
Loy, Chen Change ;
Tang, Xiaoou .
IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (04) :80-106
[3]  
Glorot Xavier, 2010, JMLR WORKSHOP C P, P249, DOI DOI 10.1109/LGRS.2016.2565705
[4]  
Hou J., 2020, P 28 ACM INT C MULTI, P816
[5]  
Howard A. G., 2017, ARXIV
[6]   Convolutional neural network based Alzheimer's disease classification from magnetic resonance brain images [J].
Jain, Rachna ;
Jain, Nikita ;
Aggarwal, Akshay ;
Hemanth, D. Jude .
COGNITIVE SYSTEMS RESEARCH, 2019, 57 :147-159
[7]  
Jin X, 2018, AAAI CONF ARTIF INTE, P77
[8]   Objectivity and Subjectivity in Aesthetic Quality Assessment of Digital Photographs [J].
Kim, Won-Hee ;
Choi, Jun-Ho ;
Lee, Jong-Seok .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2020, 11 (03) :493-506
[9]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[10]   Aesthetic Visual Quality Assessment of Paintings [J].
Li, Congcong ;
Chen, Tsuhan .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2009, 3 (02) :236-252