CONVOLUTIONAL NEURAL NETWORKS BASED ON RESIDUAL BLOCK FOR NO-REFERENCE IMAGE QUALITY ASSESSMENT OF SMARTPHONE CAMERA IMAGES

被引:0
作者
Yao, Chang [1 ]
Lu, Yuri [1 ]
Liu, Hang [1 ]
Hu, Menghan [1 ]
Li, Qingli [1 ]
机构
[1] East China Normal Univ, Shanghai Key Lab Multidim Infor Proce, Shanghai, Peoples R China
来源
2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW) | 2020年
基金
中国国家自然科学基金;
关键词
Image quality assessment (IQA); Photographic image of consumer device; Mobile phone picture; Cross-device evaluation; Attention model;
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The quality of image captured by smartphone camera is one of the most important factors influencing consumers' choice of mobile phones. Since the objective evaluation methods specifically designed for the quality assessment of smartphone camera image are relatively rare, it is meaningful to design an effective model for this challenge. In this paper, we propose a carefully-designed Convolutional Neural Network (CNN) with residual block to predict image quality without a reference image. Within the network structure, the feature extraction and regression are integrated into one optimization process. The input of network is selected using the saliency map generated by SalGAN. Experimental results show that the model proposed can obtain a better performance for quality assessment of smartphone images on all four aspects viz. color, exposure, noise and texture than the traditional noreference image quality assessment (NR IQA) methods.
引用
收藏
页数:6
相关论文
共 26 条
[1]  
[Anonymous], 2017, CVPR SCEN UND WORKSH
[2]  
Bishop C., 1995, Neural networks for pattern recognition
[3]  
Eigen D, 2014, ADV NEUR IN, V27
[4]   Greedy function approximation: A gradient boosting machine [J].
Friedman, JH .
ANNALS OF STATISTICS, 2001, 29 (05) :1189-1232
[5]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[6]  
He KM, 2015, PROC CVPR IEEE, P5353, DOI 10.1109/CVPR.2015.7299173
[7]   Robust Pre-processing Technique Based on Saliency Detection for Content Based Image Retrieval Systems [J].
Hussain, Chesti Altaff ;
Rao, D. Venkata ;
Masthani, S. Aruna .
INTERNATIONAL CONFERENCE ON COMPUTATIONAL MODELLING AND SECURITY (CMS 2016), 2016, 85 :571-580
[8]   Convolutional Neural Networks for No-Reference Image Quality Assessment [J].
Kang, Le ;
Ye, Peng ;
Li, Yi ;
Doermann, David .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :1733-1740
[9]   Deep CNN-Based Blind Image Quality Predictor [J].
Kim, Jongyoo ;
Anh-Duc Nguyen ;
Lee, Sanghoon .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (01) :11-24
[10]   Exploiting High-Level Semantics for No-Reference Image Quality Assessment of Realistic Blur Images [J].
Li, Dingquan ;
Jiang, Tingting ;
Jiang, Ming .
PROCEEDINGS OF THE 2017 ACM MULTIMEDIA CONFERENCE (MM'17), 2017, :378-386