Lightweight Super-Resolution via Grouping Fusion of Feature Frequencies

被引:0
作者
Gao, Dandan [1 ]
Zhou, Dengwen [1 ]
Wang, Wanjun [1 ]
Ma, Yu [1 ]
Li, Shanshan [1 ]
机构
[1] School of Control and Computer Engineering, North China Electric Power University, Beijing
来源
Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics | 2023年 / 35卷 / 07期
关键词
attention mechanism; convolutional neural network; feature fusion; frequency grouping; image super-resolution;
D O I
10.3724/SP.J.1089.2023.19524
中图分类号
学科分类号
摘要
The larger scale (deeper or wider) of the deep convolutional neural network, the better the performance, and the higher computing and storage capacity are required, which limits the application on resource-constrained devices. Lightweight (small number of parameters) super-resolution networks are highly needed. We propose a novel lightweight image super-resolution network based on grouping fusion of feature frequencies. Firstly, residual concatenation blocks are used to better transmit and fuse local features. Secondly, a hybrid attention block is used to combine the features of different cues and improve the expressiveness of features. Finally, a frequency feature grouping fusion block is applied to fuse the feature information of high frequency and low frequency, and improve the quality of super-resolution image restoration. The proposed network model has been trained on DIV2K dataset using the Pytorch environment and tested on standard Set5, Set14, B100, Urban100, and Manga109 test datasets. The experimental results show that the proposed network model is significantly superior to the other representative network models in terms of subjective visual quality and objective measurement of PSNR, SSIM, and LPIPS. © 2023 Institute of Computing Technology. All rights reserved.
引用
收藏
页码:1020 / 1031
页数:11
相关论文
共 57 条
[51]  
Zhang R, Isola P, Efros A A, Et al., The unreasonable effectiveness of deep features as a perceptual metric, Proceedings of the 31st IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 586-595, (2018)
[52]  
Dong C, Loy C C, Tang X O., Accelerating the super-resolution convolutional neural network, Proceedings of the European Conference on Computer Vision, pp. 391-407, (2016)
[53]  
Zhang K, Zuo W M, Zhang L., Learning a single convolutional super-resolution network for multiple degradations, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3262-3271, (2018)
[54]  
He X Y, Mo Z T, Wang P P, Et al., ODE-inspired network design for single image super-resolution, Proceedings of the 32nd IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1732-1741, (2019)
[55]  
Li W B, Zhou K, Qi L, Et al., LAPAR: linearly-assembled pixel-adaptive regression network for single image super-resolution and beyond, Proceedings of the Advances in Neural Information Processing Systems, pp. 20343-20355, (2020)
[56]  
Chen Yiming, Zhou Dengwen, Adaptive attention network for image super-resolution, Acta Automatica Sinica, 48, 8, pp. 1950-1960, (2022)
[57]  
Li Z, Yang J L, Liu Z, Et al., Feedback network for image super-resolution, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3862-3871, (2019)