Gradient information distillation network for real-time single-image super-resolution

被引:1
|
作者
Bin Meng
Lining Wang
Zheng He
Gwanggil Jeon
Qingyu Dou
Xiaomin Yang
机构
[1] Sichuan University,College of Electronics and Information Engineering
[2] Sichuan University,School of Aeronautics & Astronautics
[3] Incheon National University,Department of Embedded Systems Engineering
[4] Sichuan University,The Center of Gerontology and Geriatrics, West China Hospital
来源
Journal of Real-Time Image Processing | 2021年 / 18卷
关键词
Gradient information distillation; Super-resolution; Real-time; Deep learning;
D O I
暂无
中图分类号
学科分类号
摘要
In recent years, deep convolutional neural networks have played an increasingly important role in single-image super-resolution (SR). However, with the increase of the depth and width of networks, the super-resolution methods based on convolution neural networks are facing training difficulties, memory consumption, running slowness and other problems. Furthermore, most of the methods do not make full use of the image gradient information which leads to the loss of geometric structure information of the image. To solve these problems, we propose a gradient information distillation network in this paper. On the one hand, the advantages of fast and lightweight are maintained through information distillation. On the other hand, the SR performance is improved by gradient information. Our network has two branches named gradient information distillation branch (GIDB) and image information distillation branch. To combine features in both branches, we also introduce a residual feature transfer mechanism (RFT). Under the function of GIDB and RFT, our network can retain the rich geometric structure information which can make the edge details of the reconstructed image sharper. The experimental results show that our method is superior to the existing methods while well limits the parameters, computation and running time of the model. It provides the possibility for real-time image processing and mobile applications.
引用
收藏
页码:333 / 344
页数:11
相关论文
共 50 条
  • [31] Single-image super-resolution via local learning
    Tang, Yi
    Yan, Pingkun
    Yuan, Yuan
    Li, Xuelong
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2011, 2 (01) : 15 - 23
  • [32] Single-Image Super-Resolution Challenges: A Brief Review
    Ye, Shutong
    Zhao, Shengyu
    Hu, Yaocong
    Xie, Chao
    ELECTRONICS, 2023, 12 (13)
  • [33] Memory-efficient single-image super-resolution
    Chiapputo, Nicholas
    Bailey, Colleen P.
    BIG DATA IV: LEARNING, ANALYTICS, AND APPLICATIONS, 2022, 12097
  • [34] A lightweight multi-scale feature integration network for real-time single image super-resolution
    He, Zheng
    Liu, Kai
    Liu, Zitao
    Dou, Qingyu
    Yang, Xiaomin
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2021, 18 (04) : 1221 - 1234
  • [35] Single-image super-resolution via local learning
    Yi Tang
    Pingkun Yan
    Yuan Yuan
    Xuelong Li
    International Journal of Machine Learning and Cybernetics, 2011, 2 : 15 - 23
  • [36] Deep learning methods in real-time image super-resolution: a survey
    Li, Xiaofang
    Wu, Yirui
    Zhang, Wen
    Wang, Ruichao
    Hou, Feng
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2020, 17 (06) : 1885 - 1909
  • [37] Single-image super-resolution via selective multi-scale network
    He, Zewei
    Ding, Binjie
    Fu, Guizhong
    Cao, Yanpeng
    Yang, Jiangxin
    Cao, Yanlong
    SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (04) : 937 - 945
  • [38] A lightweight multi-scale feature integration network for real-time single image super-resolution
    Zheng He
    Kai Liu
    Zitao Liu
    Qingyu Dou
    Xiaomin Yang
    Journal of Real-Time Image Processing, 2021, 18 : 1221 - 1234
  • [39] Single Image Super-Resolution with Gradient Guidance
    Man, Wang
    Du, Xiaofeng
    2021 INTERNATIONAL CONFERENCE ON COMPUTER, CONTROL AND ROBOTICS (ICCCR 2021), 2021, : 304 - 309
  • [40] Super-Resolution Image Reconstruction Algorithm Based on Improved Information Distillation Network
    Wang Heng
    Chen Dongfang
    Wang Xiaofeng
    2021 4TH INTERNATIONAL CONFERENCE ON INTELLIGENT AUTONOMOUS SYSTEMS (ICOIAS 2021), 2021, : 123 - 128