Dual-branch feature learning network for single image super-resolution

被引:1
作者
Yu L. [1 ]
Deng Q. [1 ]
Liu B. [1 ]
Wu H. [1 ]
Hu H. [1 ]
机构
[1] College of Information and Communication Engineering, Harbin Engineering University, Harbin
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Convolutional neural network; Dual-branch feature learning; Image super-resolution;
D O I
10.1007/s11042-023-14742-1
中图分类号
学科分类号
摘要
The feature extraction ability of some existing super-resolution networks is relatively weak. And these networks do not further process the extracted features. These problems make the networks often show limited performance, resulting in blurred details and unclear edges of the reconstructed images. Therefore, further research is needed to resolve these problems. In this paper, we propose a novel dual-branch feature learning super resolution network (DBSR). The core of DBSR is the dual-branch feature learning (DB) block. In order to enhance the ability of feature extraction, the block adopts a multi-level and dual-branch structure. At the same time, some components for further processing features are introduced in each branch to maximize the learning ability of the block. The reconstructed images of DBSR are clearer than other networks in line and contour, and better results are obtained in peak signal-to-noise ratio (PSNR) and structural similarity (SSIM). For example, when the scaling factor is 2, the PSNR/SSIM on each test dataset is 38.25dB/0.9614, 34.11dB/0.9218, 32.35dB/0.9018, 32.94dB/0.9354 and 39.46dB/0.9783 respectively. The experimental results demonstrate that DBSR achieves better accuracy and visually pleasing than the current excellent methods. © 2023, The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.
引用
收藏
页码:43297 / 43314
页数:17
相关论文
共 34 条
[1]  
Agustsson E., Timofte R., Ntire 2017 challenge on single image super-resolution: dataset and study, 2017 IEEE conference on computer vision and pattern recognition workshops (CVPRW), pp. 1122-1131, (2017)
[2]  
Ahn N., Kang B., Sohn K.-A., Fast, accurate, and lightweight super-resolution with cascading residual network, In: Proceedings of the European Conference on Computer Vision (ECCV), (2018)
[3]  
Bevilacqua M., Roumy A., Guillemot C., Alberi-Morel M.L., Low-complexity single-image super-resolution based on nonnegative neighbor embedding, In: Proceedings of the 23Rd British Machine Vision Conference (BMVC), (2012)
[4]  
Chang H., Yeung D.-Y., Xiong Y., Super-resolution through neighbor embedding, In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004., 1, (2004)
[5]  
Deqiang C., Xin G., Liangliang C., Qiqi K., Kai Z., Rui G., Image super-resolution reconstruction from multi-channel recursive residual network, J Image Graph, 26, 3, pp. 605-618, (2021)
[6]  
Dong C., Loy C.C., He K., Tang X., Learning a deep convolutional network for image super-resolution, Computer vision – ECCV 2014, pp. 184-199, (2014)
[7]  
Dong C., Loy C.C., Tang X., Accelerating the super-resolution convolutional neural network, Computer Vision – ECCV 2016, pp. 391-407, (2016)
[8]  
Freedman G., Fattal R., Image and video upscaling from local self-examples, ACM Trans Graph, 30, 2, pp. 1-11, (2011)
[9]  
Freeman W.T., Jones T.R., Pasztor E.C., Example-based super-resolution, IEEE Comput Graph Appl, 22, 2, pp. 56-65, (2002)
[10]  
Fujimoto A., Ogawa T., Yamamoto K., Matsui Y., Yamasaki T., Aizawa K., Manga109 dataset and creation of metadata, In: Proceedings of the 1St International Workshop on Comics Analysis, Processing and Understanding., (2016)