MFFN: image super-resolution via multi-level features fusion network

被引:98
|
作者
Chen, Yuantao [1 ]
Xia, Runlong [2 ,3 ]
Yang, Kai [4 ]
Zou, Ke [5 ]
机构
[1] Hunan Univ Informat Technol, Sch Comp Sci & Engn, Changsha, Hunan, Peoples R China
[2] Mt Yuelu Breeding Innovat Ctr Ltd, Changsha, Peoples R China
[3] Hunan Prov Sci & Technol Affairs Ctr, Changsha, Hunan, Peoples R China
[4] Hunan ZOOMLION Intelligent Technology Corp Ltd, Changsha, Hunan, Peoples R China
[5] Hunan WUJO High Tech Mat Corp Ltd, Loudi, Peoples R China
来源
VISUAL COMPUTER | 2024年 / 40卷 / 02期
关键词
Residual learning; Multi-level features; Super-resolution; Convolutional neural network; Lightweight;
D O I
10.1007/s00371-023-02795-0
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Deep convolutional neural networks can effectively improve the performance of single-image super-resolution reconstruction. Deep networks tend to achieve better performance than others. However, the deep CNNs will lead to a dramatic increase in the size of parameters, limiting its application on embedding and resource-constrained devices, such as smart phone. To address the common problems of blurred image edges, inflexible convolution kernel size selection and slow convergence during training procedure due to redundant network structure in image super-resolution algorithms, this paper proposes a lightweight single-image super-resolution network that fusesmulti-level features. The components are mainly two-level nested residual blocks. To better extract features and reduce the number of parameters, each residual block adopts an asymmetric structure. Firstly, it expands twice and then compresses the number of channels twice. Secondly, in the residual block, the feature information of different channels is weighted and fused by adding an autocorrelation weight unit. The quality of the reconstructed image of the proposed method is superior to the existing image super-resolution reconstruction methods in both subjective perception and objective evaluation indicators, and the reconstruction performance is better when the factor is large.
引用
收藏
页码:489 / 504
页数:16
相关论文
共 50 条
  • [31] Multi-feature fusion attention network for single image super-resolution
    Chen, Jiacheng
    Wang, Wanliang
    Xing, Fangsen
    Tu, Hangyao
    IET IMAGE PROCESSING, 2023, 17 (05) : 1389 - 1402
  • [32] An image super-resolution network based on multi-scale convolution fusion
    Xin Yang
    Yitian Zhu
    Yingqing Guo
    Dake Zhou
    The Visual Computer, 2022, 38 : 4307 - 4317
  • [33] Image super-resolution via multi-view information fusion networks
    Jiang, Xinrui
    Wang, Nannan
    Xin, Jingwei
    Yang, Xi
    Yu, Yi
    Gao, Xinbo
    NEUROCOMPUTING, 2020, 402 : 29 - 37
  • [34] Image Fusion and Super-Resolution with Convolutional Neural Network
    Zhong, Jinying
    Yang, Bin
    Li, Yuehua
    Zhong, Fei
    Chen, Zhongze
    PATTERN RECOGNITION (CCPR 2016), PT II, 2016, 663 : 78 - 88
  • [35] Feature Fusion Attention Network for Image Super-resolution
    Zhou D.-W.
    Ma L.-Y.
    Tian J.-Y.
    Sun X.-X.
    Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (09): : 2233 - 2241
  • [36] Single-Image Super-Resolution Neural Network via Hybrid Multi-Scale Features
    Huang, Wenfeng
    Liao, Xiangyun
    Zhu, Lei
    Wei, Mingqiang
    Wang, Qiong
    MATHEMATICS, 2022, 10 (04)
  • [37] A Prediction-to-Prediction Remote Sensing Image Super-Resolution Network under a Multi-Level Supervision Paradigm
    Guo, Jian
    Li, Mingkai
    Zhao, Qingjie
    Xu, Qizhi
    APPLIED SCIENCES-BASEL, 2023, 13 (21):
  • [38] Multi-level feature interaction image super-resolution network based on convolutional nonlinear spiking neural model ☆
    Ye, Lulin
    Zhou, Chi
    Peng, Hong
    Wang, Jun
    Liu, Zhicai
    Yang, Qian
    NEURAL NETWORKS, 2024, 177
  • [39] Image super-resolution reconstruction algorithm of U-shaped network based on multi-level information compensation
    Song Z.-Y.
    Zhao X.-Q.
    Hui Y.-Y.
    Jiang H.-M.
    Kongzhi yu Juece/Control and Decision, 2023, 38 (09): : 2479 - 2486
  • [40] IMAGE SUPER-RESOLUTION VIA MULTI-RESOLUTION IMAGE SEQUENCE
    Chen, Xiang-Ji
    Han, Guo-Qiang
    Li, Zhan
    Liao, Xiuxiu
    2013 INTERNATIONAL CONFERENCE ON WAVELET ANALYSIS AND PATTERN RECOGNITION (ICWAPR), 2013, : 178 - 183