MDCN: Multi-Scale Dense Cross Network for Image Super-Resolution

被引:79
|
作者
Li, Juncheng [1 ,2 ]
Fang, Faming [1 ,2 ]
Li, Jiaqian [1 ,2 ]
Mei, Kangfu [3 ]
Zhang, Guixu [1 ,2 ]
机构
[1] East China Normal Univ, Shanghai Key Lab Multidimens Informat Proc, Shanghai 200062, Peoples R China
[2] East China Normal Univ, Sch Comp Sci & Technol, Shanghai 200062, Peoples R China
[3] Chinese Univ Hong Kong Shenzhen, Dept Math, Shenzhen 518172, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Image reconstruction; Adaptation models; Correlation; Image resolution; Computational modeling; Task analysis; Single image super-resolution; multi-scale; feature distillation; dynamic reconstruction; INTERPOLATION;
D O I
10.1109/TCSVT.2020.3027732
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Convolutional neural networks have been proven to be of great benefit for single-image super-resolution (SISR). However, previous works do not make full use of multi-scale features and ignore the inter-scale correlation between different upsampling factors, resulting in sub-optimal performance. Instead of blindly increasing the depth of the network, we are committed to mining image features and learning the inter-scale correlation between different upsampling factors. To achieve this, we propose a Multi-scale Dense Cross Network (MDCN), which achieves great performance with fewer parameters and less execution time. MDCN consists of multi-scale dense cross blocks (MDCBs), hierarchical feature distillation block (HFDB), and dynamic reconstruction block (DRB). Among them, MDCB aims to detect multi-scale features and maximize the use of image features flow at different scales, HFDB focuses on adaptively recalibrate channel-wise feature responses to achieve feature distillation, and DRB attempts to reconstruct SR images with different upsampling factors in a single model. It is worth noting that all these modules can run independently. It means that these modules can be selectively plugged into any CNN model to improve model performance. Extensive experiments show that MDCN achieves competitive results in SISR, especially in the reconstruction task with multiple upsampling factors. The code is provided at https://github.com/MIVRC/MDCN-PyTorch.
引用
收藏
页码:2547 / 2561
页数:15
相关论文
共 50 条
  • [41] Multi-Resolution Space-Attended Residual Dense Network for Single Image Super-Resolution
    Qin, Jiayv
    Sun, Xianfang
    Yan, Yitong
    Jin, Longcun
    Peng, Xinyi
    IEEE ACCESS, 2020, 8 (08): : 40499 - 40511
  • [42] Soft-Edge Assisted Network for Single Image Super-Resolution
    Fang, Faming
    Li, Juncheng
    Zeng, Tieyong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) : 4656 - 4668
  • [43] MS2Net: Multi-Scale and Multi-Stage Feature Fusion for Blurred Image Super-Resolution
    Niu, Axi
    Zhu, Yu
    Zhang, Chaoning
    Sun, Jinqiu
    Wang, Pei
    Kweon, In So
    Zhang, Yanning
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (08) : 5137 - 5150
  • [44] Single Image Super-Resolution via Multi-Scale Fusion Convolutional Neural Network
    Du, Xiaofeng
    He, Yifan
    Li, Jianmi
    Xie, Xiaozhu
    2017 IEEE 8TH INTERNATIONAL CONFERENCE ON AWARENESS SCIENCE AND TECHNOLOGY (ICAST), 2017, : 544 - 551
  • [45] Wide Weighted Attention Multi-Scale Network for Accurate MR Image Super-Resolution
    Wang, Haoqian
    Hu, Xiaowan
    Zhao, Xiaole
    Zhang, Yulun
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (03) : 962 - 975
  • [46] Multi-scale Fractal Coding for Single Image Super-Resolution
    Xie, Wei
    Liu, Jiwei
    Shao, Lizhen
    Jing, Fengwei
    INTELLIGENT COMPUTING THEORY, 2014, 8588 : 425 - 434
  • [47] Non-linear perceptual multi-scale network for single image super-resolution
    Yang, Aiping
    Li, Leilei
    Wang, Jinbin
    Ji, Zhong
    Pang, Yanwei
    Cao, Jiale
    Wei, Zihao
    NEURAL NETWORKS, 2022, 152 : 201 - 211
  • [49] MFCEN: A lightweight multi-scale feature cooperative enhancement network for single-image super-resolution
    Liu, Jiange
    Chen, Yu
    Dai, Xin
    Cao, Li
    Li, Qingwu
    ELECTRONIC RESEARCH ARCHIVE, 2024, 32 (10): : 5783 - 5803
  • [50] A lightweight multi-scale feature integration network for real-time single image super-resolution
    He, Zheng
    Liu, Kai
    Liu, Zitao
    Dou, Qingyu
    Yang, Xiaomin
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2021, 18 (04) : 1221 - 1234