A Residual Network with Efficient Transformer for Lightweight Image Super-Resolution

被引:0
|
作者
Yan, Fengqi [1 ]
Li, Shaokun [1 ]
Zhou, Zhiguo [1 ,2 ]
Shi, Yonggang [1 ]
机构
[1] Beijing Inst Technol, Sch Integrated Circuits & Elect, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Tangshan Res Inst, Tangshan 063000, Peoples R China
关键词
single-image super-resolution; blueprint-separable convolution; efficient transformer; spatial attention; channel attention;
D O I
10.3390/electronics13010194
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, deep learning approaches have achieved remarkable results in the field of Single-Image Super-Resolution (SISR). To attain improved performance, most existing methods focus on constructing more-complex networks that demand extensive computational resources, thereby significantly impeding the advancement and real-world application of super-resolution techniques. Furthermore, many lightweight super-resolution networks employ knowledge distillation strategies to reduce network parameters, which can considerably slow down inference speeds. In response to these challenges, we propose a Residual Network with an Efficient Transformer (RNET). RNET incorporates three effective design elements. First, we utilize Blueprint-Separable Convolution (BSConv) instead of traditional convolution, effectively reducing the computational workload. Second, we propose a residual connection structure for local feature extraction, streamlining feature aggregation and accelerating inference. Third, we introduce an efficient transformer module to enhance the network's ability to aggregate contextual features, resulting in recovered images with richer texture details. Additionally, spatial attention and channel attention mechanisms are integrated into our model, further augmenting its capabilities. We evaluate the proposed method on five general benchmark test sets. With these innovations, our network outperforms existing efficient SR methods on all test sets, achieving the best performance with the fewest parameters, particularly in the area of texture detail enhancement in images.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] EdgeFormer: Edge-Aware Efficient Transformer for Image Super-Resolution
    Luo, Xiaotong
    Ai, Zekun
    Liang, Qiuyuan
    Xie, Yuan
    Shi, Zhongchao
    Fan, Jianping
    Qu, Yanyun
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [42] LIGHTWEIGHT AND ACCURATE SINGLE IMAGE SUPER-RESOLUTION WITH CHANNEL SEGREGATION NETWORK
    Niu, Zhong-Han
    Lin, Xi-Peng
    Yu, An-Ni
    Zhou, Yang-Hao
    Yang, Yu-Bin
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1630 - 1634
  • [43] Lightweight Single Image Super-resolution with Dense Connection Distillation Network
    Li, Yanchun
    Cao, Jianglian
    Li, Zhetao
    Oh, Sangyoon
    Komuro, Nobuyoshi
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2021, 17 (01)
  • [44] Lightweight Asymmetric Convolutional Distillation Network for Single Image Super-Resolution
    Wu, Jun
    Wang, Yuxi
    Zhang, Xuguang
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 733 - 737
  • [45] Lightweight dynamic attention network for single thermal image super-resolution
    Haikun Zhang
    Yueli Hu
    Signal, Image and Video Processing, 2024, 18 : 2195 - 2206
  • [46] Adaptive Importance Learning for Improving Lightweight Image Super-Resolution Network
    Zhang, Lei
    Wang, Peng
    Shen, Chunhua
    Liu, Lingqiao
    Wei, Wei
    Zhang, Yanning
    van den Hengel, Anton
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2020, 128 (02) : 479 - 499
  • [47] Lightweight dynamic attention network for single thermal image super-resolution
    Zhang, Haikun
    Hu, Yueli
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (03) : 2195 - 2206
  • [48] Adaptive Importance Learning for Improving Lightweight Image Super-Resolution Network
    Lei Zhang
    Peng Wang
    Chunhua Shen
    Lingqiao Liu
    Wei Wei
    Yanning Zhang
    Anton van den Hengel
    International Journal of Computer Vision, 2020, 128 : 479 - 499
  • [49] A lightweight large receptive field network LrfSR for image super-resolution
    Wanqin Wang
    Shengbing Che
    Wenxin Liu
    Yangzhuo Tuo
    Yafei Du
    Zixuan Zhang
    Scientific Reports, 15 (1)
  • [50] Densely Connected Transformer With Linear Self-Attention for Lightweight Image Super-Resolution
    Zeng, Kun
    Lin, Hanjiang
    Yan, Zhiqiang
    Fang, Jinsheng
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72