Lightweight Super-Resolution via Grouping Fusion of Feature Frequencies

被引：0

作者：

Gao, Dandan ^{[1
]}

Zhou, Dengwen ^{[1
]}

Wang, Wanjun ^{[1
]}

Ma, Yu ^{[1
]}

Li, Shanshan ^{[1
]}

机构：

[1] School of Control and Computer Engineering, North China Electric Power University, Beijing

来源：

Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics | 2023年 / 35卷 / 07期

关键词：

attention mechanism; convolutional neural network; feature fusion; frequency grouping; image super-resolution;

D O I：

10.3724/SP.J.1089.2023.19524

中图分类号：

学科分类号：

摘要：

The larger scale (deeper or wider) of the deep convolutional neural network, the better the performance, and the higher computing and storage capacity are required, which limits the application on resource-constrained devices. Lightweight (small number of parameters) super-resolution networks are highly needed. We propose a novel lightweight image super-resolution network based on grouping fusion of feature frequencies. Firstly, residual concatenation blocks are used to better transmit and fuse local features. Secondly, a hybrid attention block is used to combine the features of different cues and improve the expressiveness of features. Finally, a frequency feature grouping fusion block is applied to fuse the feature information of high frequency and low frequency, and improve the quality of super-resolution image restoration. The proposed network model has been trained on DIV2K dataset using the Pytorch environment and tested on standard Set5, Set14, B100, Urban100, and Manga109 test datasets. The experimental results show that the proposed network model is significantly superior to the other representative network models in terms of subjective visual quality and objective measurement of PSNR, SSIM, and LPIPS. © 2023 Institute of Computing Technology. All rights reserved.

引用

页码：1020 / 1031

页数：11

共 57 条

[1]

Freeman W T, Pasztor E C, Carmichael O T., Learning low-level vision, International Journal of Computer Vision, 40, 1, pp. 25-47, (2000)

[2]

Zou W W W, Yuen P C., Very low resolution face recognition problem, IEEE Transactions on Image Processing, 21, 1, pp. 327-340, (2012)

[3]

Shi W Z, Caballero J, Ledig C, Et al., Cardiac image super-resolution with global correspondence using multi-atlas patchmatch, Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 9-16, (2013)

[4]

Thornton M W, Atkinson P M, Holland D A., Sub-pixel mapping of rural land cover objects from fine spatial resolution satellite sensor imagery using super-resolution pixel-swapping, International Journal of Remote Sensing, 27, 3, pp. 473-491, (2006)

[5]

Dong C, Loy C C, He K M, Et al., Learning a deep convolutional network for image super-resolution, Proceedings of the 13th European Conference on Computer Vision, pp. 184-199, (2014)

[6]

Kim J, Lee J K, Lee K M., Accurate image super-resolution using very deep convolutional networks, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1646-1654, (2016)

[7]

Tong T, Li G, Liu X J, Et al., Image super-resolution using dense skip connections, Proceedings of the IEEE International Conference on Computer Vision, pp. 4809-4817, (2017)

[8]

Lim B, Son S, Kim H, Et al., Enhanced deep residual networks for single image super-resolution, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 1132-1140, (2017)

[9]

Tai Y, Yang J, Liu X M, Et al., MemNet: a persistent memory network for image restoration, Proceedings of the IEEE International Conference on Computer Vision, pp. 4549-4557, (2017)

[10]

Zhang Y L, Li K P, Li K, Et al., Image super-resolution using very deep residual channel attention networks, Proceedings of the 15th European Conference on Computer Vision, pp. 294-310, (2018)

← 1 2 3 4 5 6 →