Spatial relaxation transformer for image super-resolution

被引:1
|
作者
Li, Yinghua [1 ]
Zhang, Ying [1 ]
Zeng, Hao [3 ]
He, Jinglu [1 ]
Guo, Jie [2 ]
机构
[1] Xian Univ Posts & Telecommun, Xian Key Lab Image Proc Technol & Applicat Publ Se, Changan West St, Xian 710121, Shaanxi, Peoples R China
[2] Xidian Univ, State Key Lab Integrated Serv Networks, 2 Southern Tai Bai Rd, Xian 710071, Shaanxi, Peoples R China
[3] Chinese Acad Sci, Inst Software, Beijing, Peoples R China
关键词
Super-resolution; Vision transformer; Feature aggregation; Image enhancement; Swin transformer;
D O I
10.1016/j.jksuci.2024.102150
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Transformer-based approaches have demonstrated remarkable performance in image processing tasks due to their ability to model long-range dependencies. Current mainstream Transformer-based methods typically confine self-attention computation within windows to reduce computational burden. However, this constraint may lead to grid artifacts in the reconstructed images due to insufficient cross-window information exchange, particularly in image super-resolution tasks. To address this issue, we propose the Multi-Scale Texture Complementation Block based on Spatial Relaxation Transformer (MSRT), which leverages features at multiple scales and augments information exchange through cross windows attention computation. In addition, we introduce a loss function based on the prior of texture smoothness transformation, which utilizes the continuity of textures between patches to constrain the generation of more coherent texture information in the reconstructed images. Specifically, we employ learnable compressive sensing technology to extract shallow features from images, preserving image features while reducing feature dimensions and improving computational efficiency. Extensive experiments conducted on multiple benchmark datasets demonstrate that our method outperforms previous state-of-the-art approaches in both qualitative and quantitative evaluations.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Dual Self-Attention Swin Transformer for Hyperspectral Image Super-Resolution
    Long, Yaqian
    Wang, Xun
    Xu, Meng
    Zhang, Shuyu
    Jiang, Shuguo
    Jia, Sen
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [42] Image reconstruction with improved super-resolution algorithm
    Chen, CY
    Kuo, YC
    Fuh, CS
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2004, 18 (08) : 1513 - 1527
  • [43] Efficiently Amalgamated CNN-Transformer Network for Image Super-Resolution Reconstruction
    Zheng, Mengyuan
    Zang, Huaijuan
    Liu, Xinzhi
    Cheng, Guoan
    Zhan, Shu
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT XI, 2024, 14435 : 3 - 13
  • [44] EHAT:Enhanced Hybrid Attention Transformer for Remote Sensing Image Super-Resolution
    Wang, Jian
    Xie, Zexin
    Du, Yanlin
    Song, Wei
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VIII, 2025, 15038 : 225 - 237
  • [45] PERCEPTION-ORIENTED OMNIDIRECTIONAL IMAGE SUPER-RESOLUTION BASED ON TRANSFORMER NETWORK
    An, Hongyu
    Zhang, Xinfeng
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3583 - 3587
  • [46] Image super-resolution method based on the interactive fusion of transformer and CNN features
    Wang, Jianxin
    Zou, Yongsong
    Alfarraj, Osama
    Sharma, Pradip Kumar
    Said, Wael
    Wang, Jin
    VISUAL COMPUTER, 2024, 40 (08) : 5827 - 5839
  • [47] Fusformer: A Transformer-Based Fusion Network for Hyperspectral Image Super-Resolution
    Hu, Jin-Fan
    Huang, Ting-Zhu
    Deng, Liang-Jian
    Dou, Hong-Xia
    Hong, Danfeng
    Vivone, Gemine
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [48] Dual-aware transformer network for single-image super-resolution
    Luo, Zhonghua
    Wang, Li
    Wang, Fengzhou
    Ruan, Yinglan
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (02)
  • [49] DTCNet: Transformer-CNN Distillation for Super-Resolution of Remote Sensing Image
    Lin, Cong
    Mao, Xin
    Qiu, Chenghao
    Zou, Lilan
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 11117 - 11133
  • [50] Hybrid-Scale Hierarchical Transformer for Remote Sensing Image Super-Resolution
    Shang, Jianrun
    Gao, Mingliang
    Li, Qilei
    Pan, Jinfeng
    Zou, Guofeng
    Jeon, Gwanggil
    REMOTE SENSING, 2023, 15 (13)