Image super-resolution reconstruction based on multi-scale feature mapping network

被引:1
|
作者
Duan R. [1 ]
Zhou D.-W. [1 ]
Zhao L.-J. [1 ]
Chai X.-L. [1 ]
机构
[1] School of Control and Computer Engineering, North China Electric Power University, Beijing
关键词
Convolutional neural network; Deep learning; Generative adversarial network; Perceptual loss; Super-resolution reconstruction;
D O I
10.3785/j.issn.1008-973X.2019.07.012
中图分类号
学科分类号
摘要
An image super-resolution reconstruction method based on multi-scale feature mapping network was proposed for the problems of shallow network, low utilization rate of features and fuzzy reconstructed images, which existed in the super-resolution convolutional neural network (SRCNN). Multi-scale low-resolution (LR) features were mapped into high-resolution (HR) feature space by learning the mapping relation between LR features and HR features, and the utilization rate of features in the reconstruction process was improved by using feature concatenation. A joint loss function consisting of the pixel-wise loss, the perceptual loss and the adversarial loss was defined, which performed well in restoring the low-frequency content, the sharp edges and the high-frequency textures of the reconstructed images. The experimental results of datasets Set5, Set14 and BSD100 for the upscaling factor 4 were compared with those of state-of-the-art methods. The proposed method performs well in improving the perceptual quality of the reconstructed images in order to achieve clearer edges and textures, and has better scores in the objective evaluation. © 2019, Zhejiang University Press. All right reserved.
引用
收藏
页码:1331 / 1339
页数:8
相关论文
共 26 条
  • [1] Yue L.W., Shen H.F., Li J., Et al., Image super-resolution: the techniques, applications, and future, Signal Processing, 128, 11, pp. 389-408, (2016)
  • [2] Lu Z.-F., Zhong B.-J., Image interpolation with predicted gradients, Acta Automatica Sinica, 44, 6, pp. 1072-1085, (2018)
  • [3] Sun J., Yuan Q.-Q., Li J.-W., Et al., License plate image super-resolution based on intensity-gradient prior combination, Journal of Image and Graphics, 23, 6, pp. 802-813, (2018)
  • [4] Yang J., Wright J., Huang T., Et al., Image super-resolution as sparse representation of raw image patches, IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-8, (2008)
  • [5] Sun X., Li X.-G., Li J.-F., Et al., Review on deep learning based image super-resolution restoration algorithms, Acta Automatica Sinica, 43, 5, pp. 697-709, (2017)
  • [6] Dong C., Chen C.L., He K., Et al., Image super-resolution using deep convolutional networks, IEEE Transactions on Pattern Analysis and Machine Intelligence, 38, 2, pp. 295-307, (2016)
  • [7] Yang S., Sun Y., Chen Y., Et al., Structural similarity regularized and sparse coding based super-resolution for medical images, Biomedical Signal Processing and Control, 7, 6, pp. 579-590, (2012)
  • [8] Dong C., Chen C.L., Tang X., Accelerating the super-resolution convolutional neural network, European Conference on Computer Vision, pp. 391-407, (2016)
  • [9] Kim J., Lee J.K., Lee K.M., Accurate image super-resolution using very deep convolutional networks, IEEE Conference on Computer Vision and Pattern Recognition, pp. 1646-1654, (2016)
  • [10] Xie Z.-Z., Wu C.-Z., Zhan S., Image super-resolution reconstruction via deep network based on edge-enhancement, Journal of Image and Graphics, 23, 1, pp. 114-122, (2018)