Dual residual and large receptive field network for lightweight image super-resolution

被引:3
作者
Pan, Lulu [1 ]
Li, Guo [1 ]
Xu, Ke [1 ]
Lv, Yanheng [1 ]
Zhang, Wenbo [1 ]
Li, Lingxiao [1 ]
Lei, Le [1 ]
机构
[1] Northwestern Polytech Univ, Sch Math & Stat, Xian 710129, Peoples R China
基金
中国国家自然科学基金;
关键词
Image super-resolution; Dual residual structure; Large receptive field; Lightweight; DISTILLATION; TRANSFORMER;
D O I
10.1016/j.neucom.2024.128158
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, there has been rapid progress in single-image super-resolution (SISR) reconstruction technology based on deep learning, but many methods face challenges in practical application due to their excessive computational requirements. To address this issue, numerous lightweight super-resolution (SR) methods have been proposed. Convolutional neural networks (CNNs) have demonstrated outstanding performance in lightweight SR reconstruction tasks. However, existing CNN-based lightweight SR networks still suffer from redundancy due to the use of small convolutional kernels and deeper network architectures for feature extraction. To solve these problems, we propose a novel network called Dual Residual and Large Receptive Field Network (DRLN), which includes two main designs. Firstly, a Large Receptive Field Feature Extraction Block (LRFEB) is proposed, which concatenates large kernel depth separable convolutions and large kernel depth separable dilated convolutions, effectively capturing spatial contextual information without increasing the number of parameters or computational burden, and enhancing the overall performance of the model. Secondly, in the Efficient Feature Distillation Block (EFDB), we innovatively propose a dual residual structure, which greatly improve the learning ability and feature expression richness of the network, and significantly improve the reconstruction performance. Extensive experiments demonstrate that DRLN surpasses BSRN which is the champion of the model complexity track of the NTIRE 2022 Efficient SR Challenge on all benchmark datasets, with fewer parameters and less computation.
引用
收藏
页数:12
相关论文
共 66 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]   Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network [J].
Ahn, Namhyuk ;
Kang, Byungkon ;
Sohn, Kyung-Ah .
COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 :256-272
[3]   Extremely Lightweight Quantization Robust Real-Time Single-Image Super Resolution for Mobile Devices [J].
Ayazoglu, Mustafa .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :2472-2479
[4]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[5]   Knowledge distillation: A good teacher is patient and consistent [J].
Beyer, Lucas ;
Zhai, Xiaohua ;
Royer, Amelie ;
Markeeva, Larisa ;
Anil, Rohan ;
Kolesnikov, Alexander .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, :10915-10924
[6]   HIPA: Hierarchical Patch Transformer for Single Image Super Resolution [J].
Cai, Qing ;
Qian, Yiming ;
Li, Jinxing ;
Lyu, Jun ;
Yang, Yee-Hong ;
Wu, Feng ;
Zhang, David .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 :3226-3237
[7]   Activating More Pixels in Image Super-Resolution Transformer [J].
Chen, Xiangyu ;
Wang, Xintao ;
Zhou, Jiantao ;
Qiao, Yu ;
Dong, Chao .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, :22367-22377
[8]   A Deep Convolutional Neural Network with Selection Units for Super-Resolution [J].
Choi, Jae-Seok ;
Kim, Munchurl .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1150-1156
[9]   Super-resolution using multi-channel merged convolutional network [J].
Chu, Jinghui ;
Li, Xiaochuan ;
Zhang, Jiaqi ;
Lu, Wei .
NEUROCOMPUTING, 2020, 394 :136-145
[10]   Second-order Attention Network for Single Image Super-Resolution [J].
Dai, Tao ;
Cai, Jianrui ;
Zhang, Yongbing ;
Xia, Shu-Tao ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11057-11066