CTE-Net: Contextual Texture Enhancement Network for Image Super-Resolution

被引:0
作者
Liu, Dong [1 ]
Wang, Xiaofeng [1 ]
Han, Ruidong [2 ,3 ]
Bai, Ningning [1 ]
Hou, Jianpeng [1 ]
Pang, Shanmin [4 ]
机构
[1] Xian Univ Technol, Dept Math, Xian 710048, Peoples R China
[2] Xian Univ Technol, Sch Comp Sci & Engn, Xian 710048, Peoples R China
[3] Yuncheng Univ, Sch Math & Informat Technol, Yuncheng 044000, Peoples R China
[4] Xi An Jiao Tong Univ, Sch Software Engn, Xian 710049, Peoples R China
基金
中国国家自然科学基金;
关键词
Image reconstruction; Feature extraction; Superresolution; Image restoration; Convolutional neural networks; Correlation; Training; Image super-resolution; contextual association feature extraction; texture detail enhancement; multi-level feature aggregation;
D O I
10.1109/TMM.2024.3374576
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The object of image super-resolution reconstruction is to overcome the limitations imposed by hardware imaging conditions and patterns, aiming to restore high-frequency details in images through signal processing techniques. Recently, deep learning-based single-image super-resolution reconstruction (SISR) has achieved remarkable performance. However, the current methods exhibit inadequate performance in the reconstruction of texture details, thereby posing a challenge for further enhancing the accuracy of super-resolution reconstruction. In this study, we propose a novel contextual texture enhancement network (CTE-Net) aimed at improving the level of texture details in image super-resolution. The CTE-Net comprises of two crucial components: the multi-level feature aggregation module (MFAM) and the contextual information enhancement module (CIEM). The MFAM integrates global and local low-resolution (LR) features from both the pixel space and channel dimensions, thereby enhancing the feature representation capability of the network. The CIEM is deployed to enhance the network's learning capacity by integrating a meticulously designed context-attention mechanism, which effectively explores the adjacent contextual information of images and thereby amplifies the expressive capability of the generated features. Moreover, we utilize local binary patterns (LBP) to guide the feature selection strategies for MFAM and CIEM, thereby prioritizing the network's decision logic towards the recovery of texture details. The extensive experiments demonstrate that our method yields satisfactory results. In comparison to the state-of-the-art approaches, our method exhibits superior performance on the benchmark datasets.
引用
收藏
页码:8000 / 8013
页数:14
相关论文
共 60 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]   Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network [J].
Ahn, Namhyuk ;
Kang, Byungkon ;
Sohn, Kyung-Ah .
COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 :256-272
[3]  
Ben Niu, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12357), P191, DOI 10.1007/978-3-030-58610-2_12
[4]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[5]   Reference-Based Image Super-Resolution with Deformable Attention Transformer [J].
Cao, Jiezhang ;
Liang, Jingyun ;
Zhang, Kai ;
Li, Yawei ;
Zhang, Yulun ;
Wang, Wenguan ;
Van Gool, Luc .
COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 :325-342
[6]   Cross Parallax Attention Network for Stereo Image Super-Resolution [J].
Chen, Canqiang ;
Qing, Chunmei ;
Xu, Xiangmin ;
Dickinson, Patrick .
IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 :202-216
[7]   Super-Resolution Enhanced Medical Image Diagnosis With Sample Affinity Interaction [J].
Chen, Zhen ;
Guo, Xiaoqing ;
Woo, Peter Y. M. ;
Yuan, Yixuan .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (05) :1377-1389
[8]   N-Gram in Swin Transformers for Efficient Lightweight Image Super-Resolution [J].
Choi, Haram ;
Lee, Jeongmin ;
Yang, Jihoon .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, :2071-2081
[9]   Describing Textures in the Wild [J].
Cimpoi, Mircea ;
Maji, Subhransu ;
Kokkinos, Iasonas ;
Mohamed, Sammy ;
Vedaldi, Andrea .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :3606-3613
[10]   Second-order Attention Network for Single Image Super-Resolution [J].
Dai, Tao ;
Cai, Jianrui ;
Zhang, Yongbing ;
Xia, Shu-Tao ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11057-11066