Spatial relaxation transformer for image super-resolution

被引:1
|
作者
Li, Yinghua [1 ]
Zhang, Ying [1 ]
Zeng, Hao [3 ]
He, Jinglu [1 ]
Guo, Jie [2 ]
机构
[1] Xian Univ Posts & Telecommun, Xian Key Lab Image Proc Technol & Applicat Publ Se, Changan West St, Xian 710121, Shaanxi, Peoples R China
[2] Xidian Univ, State Key Lab Integrated Serv Networks, 2 Southern Tai Bai Rd, Xian 710071, Shaanxi, Peoples R China
[3] Chinese Acad Sci, Inst Software, Beijing, Peoples R China
关键词
Super-resolution; Vision transformer; Feature aggregation; Image enhancement; Swin transformer;
D O I
10.1016/j.jksuci.2024.102150
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Transformer-based approaches have demonstrated remarkable performance in image processing tasks due to their ability to model long-range dependencies. Current mainstream Transformer-based methods typically confine self-attention computation within windows to reduce computational burden. However, this constraint may lead to grid artifacts in the reconstructed images due to insufficient cross-window information exchange, particularly in image super-resolution tasks. To address this issue, we propose the Multi-Scale Texture Complementation Block based on Spatial Relaxation Transformer (MSRT), which leverages features at multiple scales and augments information exchange through cross windows attention computation. In addition, we introduce a loss function based on the prior of texture smoothness transformation, which utilizes the continuity of textures between patches to constrain the generation of more coherent texture information in the reconstructed images. Specifically, we employ learnable compressive sensing technology to extract shallow features from images, preserving image features while reducing feature dimensions and improving computational efficiency. Extensive experiments conducted on multiple benchmark datasets demonstrate that our method outperforms previous state-of-the-art approaches in both qualitative and quantitative evaluations.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Lightweight Wavelet-Based Transformer for Image Super-Resolution
    Ran, Jinye
    Zhang, Zili
    PRICAI 2022: TRENDS IN ARTIFICIAL INTELLIGENCE, PT III, 2022, 13631 : 368 - 382
  • [42] LKFormer: large kernel transformer for infrared image super-resolution
    Qin, Feiwei
    Yan, Kang
    Wang, Changmiao
    Ge, Ruiquan
    Peng, Yong
    Zhang, Kai
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (28) : 72063 - 72077
  • [43] Parallel attention recursive generalization transformer for image super-resolution
    Jing Wang
    Yuanyuan Hao
    Hongxing Bai
    Lingyu Yan
    Scientific Reports, 15 (1)
  • [44] SRInpaintor: When Super-Resolution Meets Transformer for Image Inpainting
    Li, Feng
    Li, Anqi
    Qin, Jia
    Bai, Huihui
    Lin, Weisi
    Cong, Runmin
    Zhao, Yao
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2022, 8 : 743 - 758
  • [45] Efficient image super-resolution based on transformer with bidirectional interaction
    Gendy, Garas
    He, Guanghui
    Sabor, Nabil
    APPLIED SOFT COMPUTING, 2024, 165
  • [46] Focal Aggregation Transformer for Light Field Image Super-Resolution
    Wang, Shunzhou
    Lu, Yao
    Xia, Wang
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VIII, 2025, 15038 : 524 - 538
  • [47] A Residual Network with Efficient Transformer for Lightweight Image Super-Resolution
    Yan, Fengqi
    Li, Shaokun
    Zhou, Zhiguo
    Shi, Yonggang
    ELECTRONICS, 2024, 13 (01)
  • [48] Image super-resolution using dilated neighborhood attention transformer
    Chen, Li
    Zuo, Jinnian
    Du, Kai
    Zou, Jinsong
    Yin, Shaoyun
    Wang, Jinyu
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (02)
  • [49] MSDformer: Multiscale Deformable Transformer for Hyperspectral Image Super-Resolution
    Chen, Shi
    Zhang, Lefei
    Zhang, Liangpei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [50] ENHANCING SPATIAL RESOLUTION OF BUILDING DATASETS USING TRANSFORMER-BASED SINGLE-IMAGE SUPER-RESOLUTION
    Cai, Yuwei
    He, Hongjie
    He, Zhimeng
    Chapman, Michael A.
    Li, Jing
    Ma, Lingfei
    Li, Jonathan
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6338 - 6341