CNN-based repetitive self-revised learning for photos' aesthetics imbalanced classification

被引:1
作者
Dai, Ying [1 ]
机构
[1] Iwate Prefectural Univ, Fac Software & Informat Sci, Takizawa, Japan
来源
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR) | 2021年
关键词
photo aesthetic assessment; repetitive self-revised deep learning; dropping out sample; imbalanced classification; transfer learning; highlight;
D O I
10.1109/ICPR48806.2021.9412874
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aesthetic assessment is subjective, and the distribution of the aesthetic levels is imbalanced. In order to realize the auto-assessment of photo aesthetics, we focus on using repetitive self-revised learning (RSRL) to train the CNN-based aesthetics classification network by imbalanced data set. As RSRL, the network is trained repetitively by dropping out the low likelihood photo samples at the middle levels of aesthetics from the training data set based on the previously trained network. Further, the retained two networks are used in extracting highlight regions of the photos related with the aesthetic assessment. Experimental results show that the CNN-based repetitive self-revised learning is effective for improving the performances of the imbalanced classification.
引用
收藏
页码:331 / 338
页数:8
相关论文
共 12 条
[1]   Adaptive Fractional Dilated Convolution Network for Image Aesthetics Assessment [J].
Chen, Qiuyu ;
Zhang, Wei ;
Zhou, Ning ;
Lei, Peng ;
Xu, Yi ;
Zheng, Yu ;
Fan, Jianping .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :14102-14111
[2]   Multi-level photo quality assessment with multi-view features [J].
Dong, Zhe ;
Tian, Xinmei .
NEUROCOMPUTING, 2015, 168 :308-319
[3]   Learning from Imbalanced Data [J].
He, Haibo ;
Garcia, Edwardo A. .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2009, 21 (09) :1263-1284
[4]   Learning Deep Representation for Imbalanced Classification [J].
Huang, Chen ;
Li, Yining ;
Loy, Chen Change ;
Tang, Xiaoou .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :5375-5384
[5]   Understanding Aesthetics and Fitness Measures in Evolutionary Art Systems [J].
Johnson, Colin G. ;
McCormack, Jon ;
Santos, Iria ;
Romero, Juan .
COMPLEXITY, 2019, 2019
[6]   Fundamental visual features for aesthetic classification of photographs across datasets [J].
Lemarchand, Francois .
PATTERN RECOGNITION LETTERS, 2018, 112 :9-17
[7]  
Mavridaki E, 2015, IEEE IMAGE PROC, P887, DOI 10.1109/ICIP.2015.7350927
[8]  
Murray N, 2012, PROC CVPR IEEE, P2408, DOI 10.1109/CVPR.2012.6247954
[9]   Photograph aesthetical evaluation and classification with deep convolutional neural networks [J].
Tan, Yunlan ;
Tang, Pengjie ;
Zhou, Yimin ;
Luo, Wenlang ;
Kang, Yongping ;
Li, Guangyao .
NEUROCOMPUTING, 2017, 228 :165-175
[10]  
Yubin Chen Change Loy, ARXIV161000838V2