Exploiting local detail in single image super-resolution via hypergraph convolution

被引:1
作者
Wang, Bufan [1 ]
Zhang, Yongjun [1 ]
Gao, Weihao [1 ]
Yao, He [1 ]
Chen, Ruzhong [2 ]
机构
[1] Guizhou Univ, Coll Comp Sci & Technol, State Key Lab Publ Big Data, Guiyang 550025, Guizhou, Peoples R China
[2] North China Inst Sci & Technol, Langfang, Hebei, Peoples R China
关键词
Image super-resolution; Deep learning; Hypergraph convolution; Local detail features; Non-local attention; NETWORK;
D O I
10.1007/s00530-024-01355-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Exploiting both local detail features and global correlation information in low-resolution (LR) images is vital for single-image super-resolution (SISR) reconstruction. Current deep CNN methods often overlook the interaction of local details while focusing on global features, rendering them incapable of accommodating both global and local features of LR images, therefore compromising the reconstruction performance. To address this, we propose a hypergraph convolution super-resolution (HCSR) network, which integrates local detail feature information and global correlation information. Hypergraph convolution is innovatively incorporated into SISR tasks, facilitating the modeling of complex spatial relationships among local features. We devise an incidence matrix for hypergraph convolution and propose a spatial feature interaction module (SFIM) for enriched local texture detail. We also use multi-hyperplane locally sensitive hash for efficient non-local hash attention (NLHA), optimally extracting correlations among global features. Based on this, a feature forward module (FFM) is developed that integrates global dependencies of multi-level features, improving the overall image detail recovery. Evaluated across five benchmark datasets, the proposed demonstrates substantial performance in both quantitative metrics and visual appeal.
引用
收藏
页数:16
相关论文
共 67 条
  • [1] Densely Residual Laplacian Super-Resolution
    Anwar, Saeed
    Barnes, Nick
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (03) : 1192 - 1204
  • [2] Hypergraph convolution and hypergraph attention
    Bai, Song
    Zhang, Feihu
    Torr, Philip H. S.
    [J]. PATTERN RECOGNITION, 2021, 110
  • [3] Ben Niu, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12357), P191, DOI 10.1007/978-3-030-58610-2_12
  • [4] Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding
    Bevilacqua, Marco
    Roumy, Aline
    Guillemot, Christine
    Morel, Marie-Line Alberi
    [J]. PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
  • [5] TCCL-Net: Transformer-Convolution Collaborative Learning Network for Omnidirectional Image Super-Resolution
    Chai, Xiongli
    Shao, Feng
    Jiang, Qiuping
    Ying, Hongwei
    [J]. KNOWLEDGE-BASED SYSTEMS, 2023, 274
  • [6] Chen HY, 2021, Arxiv, DOI arXiv:2104.09497
  • [7] Activating More Pixels in Image Super-Resolution Transformer
    Chen, Xiangyu
    Wang, Xintao
    Zhou, Jiantao
    Qiao, Yu
    Dong, Chao
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 22367 - 22377
  • [8] Learning a Deep Convolutional Network for Image Super-Resolution
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 : 184 - 199
  • [9] Du Z., 2022, P IEEECVF C COMPUTER, P853
  • [10] Feng YF, 2019, AAAI CONF ARTIF INTE, P3558