Blind Image Quality Assessment via Deep Recursive Convolutional Network with Skip Connection

被引:1
作者
Yan, Qingsen [1 ,3 ]
Sun, Jinqiu [2 ]
Su, Shaolin [1 ]
Zhu, Yu [1 ]
Li, Haisen [1 ]
Zhang, Yanning [1 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci & Engn, Xian, Peoples R China
[2] Northwestern Polytech Univ, Sch Astronaut, Xian, Peoples R China
[3] Univ Adelaide, Sch Comp Sci, Adelaide, SA, Australia
来源
PATTERN RECOGNITION AND COMPUTER VISION, PT II | 2018年 / 11257卷
关键词
Image quality assessment (IQA); Feature extraction Deep learning; Convolutional neural networks (CNN); Skip layer No-reference (NR);
D O I
10.1007/978-3-030-03335-4_5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The performance of traditional image quality assessment (IQA) methods are not robust, due to those methods exploit shallow hand-designed features. It has been demonstrated that deep neural network can learn more effective features compared with the traditional methods. In this paper we propose a multi-scale recursive deep neural network to accurately predict image quality. In order to learn more effective feature representations for IQA, many deep learning based works focus on using more layers and deeper network structure. However, deeper network layers introduce large numbers of parameters, which causes huge difficulty in training. The proposed recursive convolution layer ensures both the depth of the network and the light of parameters, which guarantees the convergence of training procedure. Moreover, extracting multi-scale features is the most prevalent approach in IQA. Based on this criteria, we using skip connection to combine information among layers, and it further enriches the coarse and fine features for quality assessment. The experimental results on the LIVE, CISQ and TID2013 databases show that the proposed algorithm outperforms all of the state-of-the-art methods, which verifies the effectiveness of our network architecture.
引用
收藏
页码:51 / 61
页数:11
相关论文
共 34 条
  • [1] [Anonymous], 2010, P ADV NEUR INF PROC
  • [2] [Anonymous], 2017, COMPUTER VISION PATT
  • [3] On the use of deep learning for blind image quality assessment
    Bianco, Simone
    Celona, Luigi
    Napoletano, Paolo
    Schettini, Raimondo
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2018, 12 (02) : 355 - 362
  • [4] Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment
    Bosse, Sebastian
    Maniry, Dominique
    Mueller, Klaus-Robert
    Wiegand, Thomas
    Samek, Wojciech
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) : 206 - 219
  • [5] Ciresan D, 2012, PROC CVPR IEEE, P3642, DOI 10.1109/CVPR.2012.6248110
  • [6] Gu K, 2014, IEEE IMAGE PROC, P511, DOI 10.1109/ICIP.2014.7025102
  • [7] Blind Image Quality Assessment via Deep Learning
    Hou, Weilong
    Gao, Xinbo
    Tao, Dacheng
    Li, Xuelong
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (06) : 1275 - 1286
  • [8] Convolutional Neural Networks for No-Reference Image Quality Assessment
    Kang, Le
    Ye, Peng
    Li, Yi
    Doermann, David
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 1733 - 1740
  • [9] Kim J, 2016, PROC CVPR IEEE, P1637, DOI [10.1109/CVPR.2016.182, 10.1109/CVPR.2016.181]
  • [10] Most apparent distortion: full-reference image quality assessment and the role of strategy
    Larson, Eric C.
    Chandler, Damon M.
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2010, 19 (01)