Lightweight Super-Resolution via Grouping Fusion of Feature Frequencies

被引:0
作者
Gao, Dandan [1 ]
Zhou, Dengwen [1 ]
Wang, Wanjun [1 ]
Ma, Yu [1 ]
Li, Shanshan [1 ]
机构
[1] School of Control and Computer Engineering, North China Electric Power University, Beijing
来源
Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics | 2023年 / 35卷 / 07期
关键词
attention mechanism; convolutional neural network; feature fusion; frequency grouping; image super-resolution;
D O I
10.3724/SP.J.1089.2023.19524
中图分类号
学科分类号
摘要
The larger scale (deeper or wider) of the deep convolutional neural network, the better the performance, and the higher computing and storage capacity are required, which limits the application on resource-constrained devices. Lightweight (small number of parameters) super-resolution networks are highly needed. We propose a novel lightweight image super-resolution network based on grouping fusion of feature frequencies. Firstly, residual concatenation blocks are used to better transmit and fuse local features. Secondly, a hybrid attention block is used to combine the features of different cues and improve the expressiveness of features. Finally, a frequency feature grouping fusion block is applied to fuse the feature information of high frequency and low frequency, and improve the quality of super-resolution image restoration. The proposed network model has been trained on DIV2K dataset using the Pytorch environment and tested on standard Set5, Set14, B100, Urban100, and Manga109 test datasets. The experimental results show that the proposed network model is significantly superior to the other representative network models in terms of subjective visual quality and objective measurement of PSNR, SSIM, and LPIPS. © 2023 Institute of Computing Technology. All rights reserved.
引用
收藏
页码:1020 / 1031
页数:11
相关论文
共 57 条
[21]  
Liu J, Zhang W J, Tang Y T, Et al., Residual feature aggregation network for image super-resolution, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2356-2365, (2020)
[22]  
Liu J, Tang J, Wu G S., Residual feature distillation network for lightweight image super-resolution, Proceedings of the European Conference on Computer Vision, pp. 41-55, (2020)
[23]  
Lan R S, Sun L, Liu Z B, Et al., MADNet: a fast and lightweight network for single-image super resolution, IEEE Transactions on Cybernetics, 51, 3, pp. 1443-1453, (2021)
[24]  
Hu J, Shen L, Albanie S, Et al., Squeeze-and-excitation networks, EEE Transactions on Pattern Analysis and Machine Intelligence, 42, 8, pp. 2011-2023, (2020)
[25]  
Woo S, Park J, Lee J Y, Et al., CBAM: convolutional block attention module, Proceedings of the European Conference on Computer Vision, pp. 3-19, (2018)
[26]  
Wang Q L, Wu B G, Zhu P F, Et al., ECA-net: efficient channel attention for deep convolutional neural networks, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11531-11539, (2020)
[27]  
Huang J B, Singh A, Ahuja N., Single image super-resolution from transformed self-exemplars, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5197-5206, (2015)
[28]  
He K M, Zhang X Y, Ren S Q, Et al., Deep residual learning for image recognition, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770-778, (2016)
[29]  
Huang Zhiyong, Li Wenbin, Li Jinxin, Et al., Dual-path attention network for single image super-resolution, Expert Systems with Applications, 169, (2021)
[30]  
Qiu Y J, Wang R X, Tao D P, Et al., Embedded block residual network: a recursive restoration model for single-image super-resolution, Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 1479-4188, (2019)