RSTSRN: Recursive Swin Transformer Super-Resolution Network for Mars Images

被引:0
|
作者
Wu, Fanlu [1 ,2 ]
Jiang, Xiaonan [1 ]
Fu, Tianjiao [1 ]
Fu, Yao [1 ]
Xu, Dongdong [1 ]
Zhao, Chunlei [1 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China
[2] Chinese Acad Sci, Key Lab Lunar & Deep Space Explorat, Beijing 100101, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 20期
基金
中国国家自然科学基金;
关键词
super-resolution reconstruction; Swin Transformer; Laplacian Pyramid; BACK-PROJECTION NETWORKS; SUPER RESOLUTION; RECONSTRUCTION; ROVER; MRI;
D O I
10.3390/app14209286
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
High-resolution optical images will provide planetary geology researchers with finer and more microscopic image data information. In order to maximize scientific output, it is necessary to further increase the resolution of acquired images, so image super-resolution (SR) reconstruction techniques have become the best choice. Aiming at the problems of large parameter quantity and high computational complexity in current deep learning-based image SR reconstruction methods, we propose a novel Recursive Swin Transformer Super-Resolution Network (RSTSRN) for SR applied to images. The RSTSRN improves upon the LapSRN, which we use as our backbone architecture. A Residual Swin Transformer Block (RSTB) is used for more efficient residual learning, which consists of stacked Swin Transformer Blocks (STBs) with a residual connection. Moreover, the idea of parameter sharing was introduced to reduce the number of parameters, and a multi-scale training strategy was designed to accelerate convergence speed. Experimental results show that the proposed RSTSRN achieves superior performance on 2x, 4x and 8xSR tasks to state-of-the-art methods with similar parameters. Especially on high-magnification SR tasks, the RSTSRN has great performance superiority. Compared to the LapSRN network, for 2x, 4x and 8x Mars image SR tasks, the RSTSRN network has increased PSNR values by 0.35 dB, 0.88 dB and 1.22 dB, and SSIM values by 0.0048, 0.0114 and 0.0311, respectively.
引用
收藏
页数:18
相关论文
共 50 条
  • [31] Learning Texture Transformer Network for Image Super-Resolution
    Yang, Fuzhi
    Yang, Huan
    Fu, Jianlong
    Lu, Hongtao
    Guo, Baining
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5790 - 5799
  • [32] Chest X-ray images super-resolution reconstruction via recursive neural network
    Chao-Yue Zhao
    Rui-Sheng Jia
    Qing-Ming Liu
    Xiao-Ying Liu
    Hong-Mei Sun
    Xing-Li Zhang
    Multimedia Tools and Applications, 2021, 80 : 263 - 277
  • [33] Chest X-ray images super-resolution reconstruction via recursive neural network
    Zhao, Chao-Yue
    Jia, Rui-Sheng
    Liu, Qing-Ming
    Liu, Xiao-Ying
    Sun, Hong-Mei
    Zhang, Xing-Li
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (01) : 263 - 277
  • [34] Texture Transformer Super-Resolution (TTSR) for Patient CT Images
    Zhou, S.
    Yu, L.
    Jin, M.
    MEDICAL PHYSICS, 2022, 49 (06) : E591 - E591
  • [35] Double Transformer Super-Resolution for Breast Cancer ADC Images
    Yang, Ying
    Xiang, Tao
    Lv, Xiao
    Li, Lihua
    Lui, Lok Ming
    Zeng, Tieyong
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (02) : 917 - 928
  • [36] Deeply-Recursive Convolutional Network for Image Super-Resolution
    Kim, Jiwon
    Lee, Jung Kwon
    Lee, Kyoung Mu
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 1637 - 1645
  • [37] Image super-resolution via a densely connected recursive network
    Feng, Zhanxiang
    Lai, Jianhuang
    Xie, Xiaohua
    Zhu, Junyong
    NEUROCOMPUTING, 2018, 316 : 270 - 276
  • [38] Lightweight and Accurate Recursive Fractal Network for Image Super-Resolution
    Li, Juncheng
    Yuan, Yiting
    Mei, Kangfu
    Fang, Faming
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3814 - 3823
  • [39] Image Super-Resolution via Deep Recursive Residual Network
    Tai, Ying
    Yang, Jian
    Liu, Xiaoming
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2790 - 2798
  • [40] Mars image super-resolution based on generative adversarial network
    Wang, Cong
    Zhang, Yin
    Zhang, Yongqiang
    Tian, Rui
    Ding, Mingli
    Zhang, Yongqiang (yongqiang.zhang.hit@gmail.com); Ding, Mingli (mingli.ding.hit@gmail.com), 1600, Institute of Electrical and Electronics Engineers Inc. (09): : 108889 - 108898