Hybrid-Scale Hierarchical Transformer for Remote Sensing Image Super-Resolution

被引:9
|
作者
Shang, Jianrun [1 ]
Gao, Mingliang [1 ]
Li, Qilei [2 ]
Pan, Jinfeng [1 ]
Zou, Guofeng [1 ]
Jeon, Gwanggil [1 ,3 ]
机构
[1] Shandong Univ Technol, Sch Elect & Elect Engn, Zibo 255000, Peoples R China
[2] Queen Mary Univ London, Sch Elect Engn & Comp Sci, London E1 4NS, England
[3] Incheon Natl Univ, Dept Embedded Syst Engn, Incheon 22012, South Korea
基金
中国国家自然科学基金;
关键词
super-resolution; remote sensing image; convolutional neural network; transformer; self-similarity; ALGORITHM;
D O I
10.3390/rs15133442
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Super-resolution (SR) technology plays a crucial role in improving the spatial resolution of remote sensing images so as to overcome the physical limitations of spaceborne imaging systems. Although deep convolutional neural networks have achieved promising results, most of them overlook the advantage of self-similarity information across different scales and high-dimensional features after the upsampling layers. To address the problem, we propose a hybrid-scale hierarchical transformer network (HSTNet) to achieve faithful remote sensing image SR. Specifically, we propose a hybrid-scale feature exploitation module to leverage the internal recursive information in single and cross scales within the images. To fully leverage the high-dimensional features and enhance discrimination, we designed a cross-scale enhancement transformer to capture long-range dependencies and efficiently calculate the relevance between high-dimension and low-dimension features. The proposed HSTNet achieves the best result in PSNR and SSIM with the UCMecred dataset and AID dataset. Comparative experiments demonstrate the effectiveness of the proposed methods and prove that the HSTNet outperforms the state-of-the-art competitors both in quantitative and qualitative evaluations.
引用
收藏
页数:20
相关论文
共 50 条
  • [31] Hierarchical Feature Aggregation and Self-Learning Network for Remote Sensing Image Continuous-Scale Super-Resolution
    Ni, Ning
    Wu, Hanlin
    Zhang, Libao
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [32] Enhancing Remote Sensing Image Super-Resolution with Efficient Hybrid Conditional Diffusion Model
    Han, Lintao
    Zhao, Yuchen
    Lv, Hengyi
    Zhang, Yisa
    Liu, Hailong
    Bi, Guoling
    Han, Qing
    REMOTE SENSING, 2023, 15 (13)
  • [33] A Hybrid Network of CNN and Transformer for Lightweight Image Super-Resolution
    Fang, Jinsheng
    Lin, Hanjiang
    Chen, Xinyu
    Zeng, Kun
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 1102 - 1111
  • [34] DsTer: A dense spectral transformer for remote sensing spectral super-resolution
    He, Jiang
    Yuan, Qiangqiang
    Li, Jie
    Xiao, Yi
    Liu, Xinxin
    Zou, Yun
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 109
  • [35] Single Image Super-Resolution with Application to Remote-Sensing Image
    Deeba, Farah
    Dharejo, Fayaz Ali
    Zhou, Yuanchun
    Ghaffar, Abdul
    Memon, Mujahid Hussain
    Kun, She
    2020 GLOBAL CONFERENCE ON WIRELESS AND OPTICAL TECHNOLOGIES (GCWOT), 2020,
  • [36] DTRN: DUAL TRANSFORMER RESIDUAL NETWORK FOR REMOTE SENSING SUPER-RESOLUTION
    Sui, Jialu
    Ma, Xianping
    Zhang, Xiaokang
    Pun, Man-On
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6041 - 6044
  • [37] HiT-SR: Hierarchical Transformer for Efficient Image Super-Resolution
    Zhang, Xiang
    Zhang, Yulun
    Yu, Fisher
    COMPUTER VISION - ECCV 2024, PT XL, 2025, 15098 : 483 - 500
  • [38] Saliency-Guided Remote Sensing Image Super-Resolution
    Liu, Baodi
    Zhao, Lifei
    Li, Jiaoyue
    Zhao, Hengle
    Liu, Weifeng
    Li, Ye
    Wang, Yanjiang
    Chen, Honglong
    Cao, Weijia
    REMOTE SENSING, 2021, 13 (24)
  • [39] Information Purification Network for Remote Sensing Image Super-Resolution
    Wang, Zheyuan
    Li, Liangliang
    Xing, Linxin
    Wang, Jiawen
    Sun, Kaipeng
    Ma, Hongbing
    TSINGHUA SCIENCE AND TECHNOLOGY, 2023, 28 (02): : 310 - 321
  • [40] Coupled Adversarial Training for Remote Sensing Image Super-Resolution
    Lei, Sen
    Shi, Zhenwei
    Zou, Zhengxia
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (05): : 3633 - 3643