MFFN: image super-resolution via multi-level features fusion network

被引:98
|
作者
Chen, Yuantao [1 ]
Xia, Runlong [2 ,3 ]
Yang, Kai [4 ]
Zou, Ke [5 ]
机构
[1] Hunan Univ Informat Technol, Sch Comp Sci & Engn, Changsha, Hunan, Peoples R China
[2] Mt Yuelu Breeding Innovat Ctr Ltd, Changsha, Peoples R China
[3] Hunan Prov Sci & Technol Affairs Ctr, Changsha, Hunan, Peoples R China
[4] Hunan ZOOMLION Intelligent Technology Corp Ltd, Changsha, Hunan, Peoples R China
[5] Hunan WUJO High Tech Mat Corp Ltd, Loudi, Peoples R China
来源
VISUAL COMPUTER | 2024年 / 40卷 / 02期
关键词
Residual learning; Multi-level features; Super-resolution; Convolutional neural network; Lightweight;
D O I
10.1007/s00371-023-02795-0
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Deep convolutional neural networks can effectively improve the performance of single-image super-resolution reconstruction. Deep networks tend to achieve better performance than others. However, the deep CNNs will lead to a dramatic increase in the size of parameters, limiting its application on embedding and resource-constrained devices, such as smart phone. To address the common problems of blurred image edges, inflexible convolution kernel size selection and slow convergence during training procedure due to redundant network structure in image super-resolution algorithms, this paper proposes a lightweight single-image super-resolution network that fusesmulti-level features. The components are mainly two-level nested residual blocks. To better extract features and reduce the number of parameters, each residual block adopts an asymmetric structure. Firstly, it expands twice and then compresses the number of channels twice. Secondly, in the residual block, the feature information of different channels is weighted and fused by adding an autocorrelation weight unit. The quality of the reconstructed image of the proposed method is superior to the existing image super-resolution reconstruction methods in both subjective perception and objective evaluation indicators, and the reconstruction performance is better when the factor is large.
引用
收藏
页码:489 / 504
页数:16
相关论文
共 50 条
  • [21] Single Image Super-Resolution via Multi-Scale Fusion Convolutional Neural Network
    Du, Xiaofeng
    He, Yifan
    Li, Jianmi
    Xie, Xiaozhu
    2017 IEEE 8TH INTERNATIONAL CONFERENCE ON AWARENESS SCIENCE AND TECHNOLOGY (ICAST), 2017, : 544 - 551
  • [22] Remote sensing image super-resolution guided by multi-level supervision paradigm
    Li, Mingkai
    Xu, Qizhi
    National Remote Sensing Bulletin, 2024, 28 (07) : 1746 - 1759
  • [23] A multi-level text feature enhancement super-resolution network via group convolution and wavelet transform
    Xiao, Yanting
    Tian, Xiaomei
    Guo, Yanyu
    Xiao, Yongquan
    Deng, Yong
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (05)
  • [24] Super-Resolution Reconstruction of Deep Residual Network with Multi-Level Skip Connections
    Zhao Xiaoqiang
    Song Zhaoyang
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2019, 41 (10) : 2501 - 2508
  • [25] Multi-level landmark-guided deep network for face super-resolution
    Zhuang, Cheng
    Li, Minqi
    Zhang, Kaibing
    Li, Zheng
    Lu, Jian
    NEURAL NETWORKS, 2022, 152 : 276 - 286
  • [26] Image super-resolution via dynamic network
    Tian, Chunwei
    Zhang, Xuanyu
    Zhang, Qi
    Yang, Mingming
    Ju, Zhaojie
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2024, 9 (04) : 837 - 849
  • [27] Multi-Stream Fusion Network for Multi-Distortion Image Super-Resolution
    Wen, Yang
    Xu, Yupeng
    Sheng, Bin
    Li, Ping
    Bi, Lei
    Kim, Jinman
    He, Xiangui
    Xu, Xun
    ADVANCES IN COMPUTER GRAPHICS, CGI 2021, 2021, 13002 : 242 - 251
  • [28] Multi-Level Alignments for Compressed Video Super-Resolution
    Wei, Liu
    Ye, Mao
    Ji, Luping
    Gan, Yan
    Li, Shuai
    Li, Xue
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (03) : 5101 - 5114
  • [29] An image super-resolution network based on multi-scale convolution fusion
    Yang, Xin
    Zhu, Yitian
    Guo, Yingqing
    Zhou, Dake
    VISUAL COMPUTER, 2022, 38 (12): : 4307 - 4317
  • [30] Multi-focus image fusion and super-resolution with convolutional neural network
    Yang, Bin
    Zhong, Jinying
    Li, Yuehua
    Chen, Zhongze
    INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2017, 15 (04)