Fusing global-local feature bank for single image super-resolution

被引:0
作者
Xu, Zhiyuan [1 ]
Lin, Chuan [1 ]
Yan, Hao [1 ]
Guo, Ningning [1 ]
机构
[1] Southwest Jiaotong Univ, Sch Elect Engn, Chengdu 611756, Peoples R China
关键词
Global-local feature fusion; Image super-resolution; Attention mechanism; Transformer; CNN; Deep learning;
D O I
10.1016/j.displa.2024.102932
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Previous work has shown that Transformer-based methods, which have achieved remarkable success in natural language processing (NLP), have also made significant strides in image super-resolution (e.g., SwinIR). However, these methods primarily focus on dynamically establishing long-range relationships between pixels, emphasize the reconstruction of image edges and overall structure. And they tend to overlook local texture details, making it challenging to achieve more detailed images. In order to obtain more texture information for better reconstruction, the global-local feature bank fusion network (GLFBFNet) is presented. It is a simple but effective method that attends to local contextual information while modeling long-range dependencies, and establishes a feature bank to store the extracted features, enabling the comprehensive and complete information to participate in super-resolution image reconstruction. The core components of GLFBFNet are the dual branch block (DBB) and the global-local feature bank (GLFB). The dual branch block (DBB) strikes a balance between global and local modeling, facilitating their collaborative involvement in super-resolution reconstruction. The global-local feature bank (GLFB), despite its simple structure, prevents the loss of crucial information, thereby obtaining richer information to participate in reconstruction. These two core components are straightforward to implement and can be easily applied to existing Transformer-based methods. Experimental results demonstrate that our GLFBFNet achieves PSNR scores of 33.89 dB and 39.74 dB on the Urban100 and Manga109 datasets, respectively, surpassing SwinIR by 0.49 dB and 0.14 dB respectively.
引用
收藏
页数:9
相关论文
共 48 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]  
Ben Niu, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12357), P191, DOI 10.1007/978-3-030-58610-2_12
[3]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[4]   NTIRE 2024 Challenge on Image Super-Resolution (x4): Methods and Results [J].
Chen, Zheng ;
Wu, Zongwei ;
Zamfir, Eduard ;
Zhang, Kai ;
Zhang, Yulun ;
Timofte, Radu ;
Yang, Xiaokang ;
Yu, Hongyuan ;
Wan, Cheng ;
Hong, Yuxin ;
Huang, Zhijuan ;
Zou, Yajun ;
Huang, Yuan ;
Lin, Jiamin ;
Han, Bingnan ;
Guan, Xianyu ;
Yu, Yongsheng ;
Zhang, Daoan ;
Yin, Xuanwu ;
Zuo, Kunlong ;
Hao, Jinhua ;
Zhao, Kai ;
Yuan, Kun ;
Sun, Ming ;
Zhou, Chao ;
An, Hongyu ;
Zhang, Xinfeng ;
Song, Zhiyuan ;
Dong, Ziyue ;
Zhao, Qing ;
Xu, Xiaogang ;
Wei, Pengxu ;
Dou, Zhi-chao ;
Wang, Gui-ling ;
Hsu, Chih-Chung ;
Lee, Chia-Ming ;
Chou, Yi-Shiuan ;
Korkmaz, Cansu ;
Tekalp, A. Murat ;
Wei, Yubin ;
Yan, Xiaole ;
Li, Binren ;
Chen, Haonan ;
Zhang, Siqi ;
Chen, Sihan ;
Joshi, Amogh ;
Akalwadi, Nikhil ;
Malagi, Sampada ;
Yashaswini, Palani ;
Desai, Chaitra .
2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW, 2024, :6108-6132
[5]   Second-order Attention Network for Single Image Super-Resolution [J].
Dai, Tao ;
Cai, Jianrui ;
Zhang, Yongbing ;
Xia, Shu-Tao ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11057-11066
[6]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[7]  
Dosovitskiy A, 2021, Arxiv, DOI [arXiv:2010.11929, 10.48550/arXiv.2010.11929]
[8]   Single Image Super-Resolution Using Dual-Branch Convolutional Neural Network [J].
Gao, Xiaodong ;
Zhang, Ling ;
Mou, Xianglin .
IEEE ACCESS, 2019, 7 :15767-15778
[9]   Interpreting Super-Resolution Networks with Local Attribution Maps [J].
Gu, Jinjin ;
Dong, Chao .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :9195-9204
[10]   Cross Transformer Network for Scale-Arbitrary Image Super-Resolution [J].
He, Dehong ;
Wu, Song ;
Liu, Jinpeng ;
Xiao, Guoqiang .
KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT II, 2022, 13369 :633-644