MFFN: image super-resolution via multi-level features fusion network

被引:100
作者
Chen, Yuantao [1 ]
Xia, Runlong [2 ,3 ]
Yang, Kai [4 ]
Zou, Ke [5 ]
机构
[1] Hunan Univ Informat Technol, Sch Comp Sci & Engn, Changsha, Hunan, Peoples R China
[2] Mt Yuelu Breeding Innovat Ctr Ltd, Changsha, Peoples R China
[3] Hunan Prov Sci & Technol Affairs Ctr, Changsha, Hunan, Peoples R China
[4] Hunan ZOOMLION Intelligent Technology Corp Ltd, Changsha, Hunan, Peoples R China
[5] Hunan WUJO High Tech Mat Corp Ltd, Loudi, Peoples R China
关键词
Residual learning; Multi-level features; Super-resolution; Convolutional neural network; Lightweight;
D O I
10.1007/s00371-023-02795-0
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Deep convolutional neural networks can effectively improve the performance of single-image super-resolution reconstruction. Deep networks tend to achieve better performance than others. However, the deep CNNs will lead to a dramatic increase in the size of parameters, limiting its application on embedding and resource-constrained devices, such as smart phone. To address the common problems of blurred image edges, inflexible convolution kernel size selection and slow convergence during training procedure due to redundant network structure in image super-resolution algorithms, this paper proposes a lightweight single-image super-resolution network that fusesmulti-level features. The components are mainly two-level nested residual blocks. To better extract features and reduce the number of parameters, each residual block adopts an asymmetric structure. Firstly, it expands twice and then compresses the number of channels twice. Secondly, in the residual block, the feature information of different channels is weighted and fused by adding an autocorrelation weight unit. The quality of the reconstructed image of the proposed method is superior to the existing image super-resolution reconstruction methods in both subjective perception and objective evaluation indicators, and the reconstruction performance is better when the factor is large.
引用
收藏
页码:489 / 504
页数:16
相关论文
共 39 条
  • [1] Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network
    Ahn, Namhyuk
    Kang, Byungkon
    Sohn, Kyung-Ah
    [J]. COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 : 256 - 272
  • [2] Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding
    Bevilacqua, Marco
    Roumy, Aline
    Guillemot, Christine
    Morel, Marie-Line Alberi
    [J]. PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
  • [3] Chen L.Y., P NTIRE 2022 CHALLEN
  • [4] Image super-resolution reconstruction based on feature map attention mechanism
    Chen, Yuantao
    Liu, Linwu
    Phonevilay, Volachith
    Gu, Ke
    Xia, Runlong
    Xie, Jingbo
    Zhang, Qian
    Yang, Kai
    [J]. APPLIED INTELLIGENCE, 2021, 51 (07) : 4367 - 4380
  • [5] The improved image inpainting algorithm via encoder and similarity constraint
    Chen, Yuantao
    Liu, Linwu
    Tao, Jiajun
    Xia, Runlong
    Zhang, Qian
    Yang, Kai
    Xiong, Jie
    Chen, Xi
    [J]. VISUAL COMPUTER, 2021, 37 (07) : 1691 - 1705
  • [6] Multi-label learning for concept-oriented labels of product image data
    Dai, Yong
    Li, Yi
    Li, Shu-Tao
    [J]. IMAGE AND VISION COMPUTING, 2020, 93
  • [7] Accelerating the Super-Resolution Convolutional Neural Network
    Dong, Chao
    Loy, Chen Change
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 391 - 407
  • [8] Learning a Deep Convolutional Network for Image Super-Resolution
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 : 184 - 199
  • [9] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [10] Huang JB, 2015, PROC CVPR IEEE, P5197, DOI 10.1109/CVPR.2015.7299156