MFFN: image super-resolution via multi-level features fusion network

被引:98
|
作者
Chen, Yuantao [1 ]
Xia, Runlong [2 ,3 ]
Yang, Kai [4 ]
Zou, Ke [5 ]
机构
[1] Hunan Univ Informat Technol, Sch Comp Sci & Engn, Changsha, Hunan, Peoples R China
[2] Mt Yuelu Breeding Innovat Ctr Ltd, Changsha, Peoples R China
[3] Hunan Prov Sci & Technol Affairs Ctr, Changsha, Hunan, Peoples R China
[4] Hunan ZOOMLION Intelligent Technology Corp Ltd, Changsha, Hunan, Peoples R China
[5] Hunan WUJO High Tech Mat Corp Ltd, Loudi, Peoples R China
来源
VISUAL COMPUTER | 2024年 / 40卷 / 02期
关键词
Residual learning; Multi-level features; Super-resolution; Convolutional neural network; Lightweight;
D O I
10.1007/s00371-023-02795-0
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Deep convolutional neural networks can effectively improve the performance of single-image super-resolution reconstruction. Deep networks tend to achieve better performance than others. However, the deep CNNs will lead to a dramatic increase in the size of parameters, limiting its application on embedding and resource-constrained devices, such as smart phone. To address the common problems of blurred image edges, inflexible convolution kernel size selection and slow convergence during training procedure due to redundant network structure in image super-resolution algorithms, this paper proposes a lightweight single-image super-resolution network that fusesmulti-level features. The components are mainly two-level nested residual blocks. To better extract features and reduce the number of parameters, each residual block adopts an asymmetric structure. Firstly, it expands twice and then compresses the number of channels twice. Secondly, in the residual block, the feature information of different channels is weighted and fused by adding an autocorrelation weight unit. The quality of the reconstructed image of the proposed method is superior to the existing image super-resolution reconstruction methods in both subjective perception and objective evaluation indicators, and the reconstruction performance is better when the factor is large.
引用
收藏
页码:489 / 504
页数:16
相关论文
共 50 条
  • [41] Image super-resolution reconstruction algorithm based on multi-level continuous encoding and decoding
    Song Z.-Y.
    Zhao X.-Q.
    Hui Y.-Y.
    Jiang H.-M.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2023, 57 (09): : 1885 - 1893
  • [42] Light Field Spatial Super-resolution via Multi-level Perception and View Reorganization
    Mao, Yifan
    Tong, Zaidong
    Zheng, Xin
    Zhou, Xiaofei
    Zhang, Youzhi
    Liu, Deyang
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (05) : 1075 - 1083
  • [43] GAN-BASED MULTI-LEVEL MAPPING NETWORK FOR SATELLITE IMAGERY SUPER-RESOLUTION
    Jiang, Kui
    Wang, Zhongyuan
    Yi, Peng
    Jiang, Junjun
    Wang, Guangcheng
    Han, Zhen
    Lu, Tao
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 526 - 531
  • [44] Image super-resolution via enhanced multi-scale residual network
    Wang, MengJie
    Yang, Xiaomin
    Anisetti, Marco
    Zhang, Rongzhu
    Albertini, Marcelo Keese
    Liu, Kai
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2021, 152 : 57 - 66
  • [45] Single Image Super-Resolution via Edge Reconstruction and Image Fusion
    Sun, Guangling
    Shen, Zhoubiao
    SIGNAL PROCESSING AND MULTIMEDIA, 2010, 123 : 16 - 23
  • [46] (MLE2A2U)-Net: Image Super-Resolution via Multi-Level Edge Embedding and Aggregated Attentive Upsampler Network
    Mehta, Nancy
    Murala, Subrahmanyam
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2023, 7 (02): : 523 - 536
  • [47] Image super-resolution via deep residual network
    Duan, Yakang
    Luo, Lin
    Zhang, Yu
    Zhu, Hongna
    ELEVENTH INTERNATIONAL CONFERENCE ON INFORMATION OPTICS AND PHOTONICS (CIOP 2019), 2019, 11209
  • [48] IMAGE SUPER-RESOLUTION VIA DEEP AGGREGATION NETWORK
    Wang, Xinya
    Ma, Jiayi
    Jiang, Junjun
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 1747 - 1751
  • [49] Hyperspectral Image Super-Resolution via Intrafusion Network
    Hu, Jing
    Jia, Xiuping
    Li, Yunsong
    He, Gang
    Zhao, Minghua
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (10): : 7459 - 7471
  • [50] Multi-Scale Residual Fusion Network for Super-Resolution Reconstruction of Single Image
    Zhao, Baiting
    Hu, Rui
    Jia, Xiaofen
    Guo, Yongcun
    IEEE ACCESS, 2020, 8 : 155285 - 155295