Exploiting local detail in single image super-resolution via hypergraph convolution

被引:1
作者
Wang, Bufan [1 ]
Zhang, Yongjun [1 ]
Gao, Weihao [1 ]
Yao, He [1 ]
Chen, Ruzhong [2 ]
机构
[1] Guizhou Univ, Coll Comp Sci & Technol, State Key Lab Publ Big Data, Guiyang 550025, Guizhou, Peoples R China
[2] North China Inst Sci & Technol, Langfang, Hebei, Peoples R China
关键词
Image super-resolution; Deep learning; Hypergraph convolution; Local detail features; Non-local attention; NETWORK;
D O I
10.1007/s00530-024-01355-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Exploiting both local detail features and global correlation information in low-resolution (LR) images is vital for single-image super-resolution (SISR) reconstruction. Current deep CNN methods often overlook the interaction of local details while focusing on global features, rendering them incapable of accommodating both global and local features of LR images, therefore compromising the reconstruction performance. To address this, we propose a hypergraph convolution super-resolution (HCSR) network, which integrates local detail feature information and global correlation information. Hypergraph convolution is innovatively incorporated into SISR tasks, facilitating the modeling of complex spatial relationships among local features. We devise an incidence matrix for hypergraph convolution and propose a spatial feature interaction module (SFIM) for enriched local texture detail. We also use multi-hyperplane locally sensitive hash for efficient non-local hash attention (NLHA), optimally extracting correlations among global features. Based on this, a feature forward module (FFM) is developed that integrates global dependencies of multi-level features, improving the overall image detail recovery. Evaluated across five benchmark datasets, the proposed demonstrates substantial performance in both quantitative metrics and visual appeal.
引用
收藏
页数:16
相关论文
共 67 条
[61]   Residual Dense Network for Image Super-Resolution [J].
Zhang, Yulun ;
Tian, Yapeng ;
Kong, Yu ;
Zhong, Bineng ;
Fu, Yun .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2472-2481
[62]  
Zhao H., 2020, COMPUTER VISION ECCV, P56, DOI [10.1007/978-3-030-67070-2_3, DOI 10.1007/978-3-030-67070-2_3]
[63]   Progressive Deep Non-Negative Matrix Factorization Architecture with Graph Convolution-based Basis Image Reorganization [J].
Zhao, Yang ;
Deng, Furong ;
Pei, Jihong ;
Yang, Xuan .
PATTERN RECOGNITION, 2022, 132
[64]  
Zhou L., 2022, EUR C COMP VIS, P256, DOI [10.1007/978-3-031-25063-7_16, DOI 10.48550/ARXIV.2210.05960]
[65]  
Zhou S, 2020, Advances in Neural Information Processing Systems, V33, P3499
[66]  
Zhu Qiang, 2023, 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), P1756, DOI 10.1109/CVPRW59228.2023.00176
[67]  
Zontak M, 2011, PROC CVPR IEEE, P977, DOI 10.1109/CVPR.2011.5995401