Super-Resolution Reconstruction of Deep Residual Network with Multi-Level Skip Connections

被引:9
|
作者
Zhao Xiaoqiang [1 ,2 ,3 ]
Song Zhaoyang [1 ]
机构
[1] Lanzhou Univ Technol, Coll Elect Engn & Informat Engn, Lanzhou 730050, Gansu, Peoples R China
[2] Lanzhou Univ Technol, Key Lab Gansu Adv Control Ind Proc, Lanzhou 730050, Gansu, Peoples R China
[3] Lanzhou Univ Technol, Natl Expt Teaching Ctr Elect & Control Engn, Lanzhou 730050, Gansu, Peoples R China
基金
中国国家自然科学基金;
关键词
Super-resolution reconstruction; Deep residual network; Residual network with multi-level skip connections; Stochastic Gradient Descent (SGD); INTELLIGENCE;
D O I
10.11999/JEIT190036
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The Fast Super-Resolution Convolutional Neural Network algorithm (FSRCNN) is difficult to extract deep image information due to the small number of convolution layers and the correlation lack between the feature information of adjacent convolutional layers. To solve this problem, a deep residual network super-resolution reconstruction method with multi-level skip connections is proposed. Firstly, a residual block with multi-level skip connections is designed to solve the problem that the characteristic information of adjacent convolutional layers lacks relevance. A deep residual network with multi-level skip connections is constructed on the basis of the residual block. Then, the deep residual network connected to the multi-level skip is trained by using the adaptive gradient rate strategy of Stochastic Gradient Descent (SGD) method and the network super-resolution reconstruction model is obtained. Finally, the low-resolution image is input into the deep residual network super-resolution reconstruction model with the multi-level skip connections, and the residual eigenvalue is obtained by the residual block connected the multi-level skip connections. The residual eigenvalue and the low resolution image are combined and converted into a high resolution image. The proposed method is compared with the bicubic, A+, SRCNN, FSRCNN and ESPCN algorithms in the Set5 and Set14 test sets. The proposed method is superior to other comparison algorithms in terms of visual effects and evaluation index values.
引用
收藏
页码:2501 / 2508
页数:8
相关论文
共 29 条
  • [1] Accelerating the Super-Resolution Convolutional Neural Network
    Dong, Chao
    Loy, Chen Change
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 391 - 407
  • [2] Image Super-Resolution Using Deep Convolutional Networks
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) : 295 - 307
  • [3] MONOTONE PIECEWISE CUBIC INTERPOLATION
    FRITSCH, FN
    CARLSON, RE
    [J]. SIAM JOURNAL ON NUMERICAL ANALYSIS, 1980, 17 (02) : 238 - 246
  • [4] Bilinear and bicubic interpolation methods for division of focal plane polarimeters
    Gao, Shengkui
    Gruev, Viktor
    [J]. OPTICS EXPRESS, 2011, 19 (27): : 26161 - 26173
  • [5] Gribbon KT, 2004, INT SYM ELECT DES TE, P126
  • [6] He K., 2016, IEEE C COMPUT VIS PA, DOI [10.1007/978-3-319-46493-0_38, DOI 10.1007/978-3-319-46493-0_38, DOI 10.1109/CVPR.2016.90]
  • [7] Kermany Daniel, 2018, Mendeley Data, V3
  • [8] Kim J, 2016, PROC CVPR IEEE, P1637, DOI [10.1109/CVPR.2016.181, 10.1109/CVPR.2016.182]
  • [9] Artificial Intelligence Is Becoming Natural
    Koch, Marta
    [J]. CELL, 2018, 173 (03) : 531 - 532
  • [10] Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
    Ledig, Christian
    Theis, Lucas
    Huszar, Ferenc
    Caballero, Jose
    Cunningham, Andrew
    Acosta, Alejandro
    Aitken, Andrew
    Tejani, Alykhan
    Totz, Johannes
    Wang, Zehan
    Shi, Wenzhe
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 105 - 114