Hybrid-Scale Hierarchical Transformer for Remote Sensing Image Super-Resolution

被引:9
作者
Shang, Jianrun [1 ]
Gao, Mingliang [1 ]
Li, Qilei [2 ]
Pan, Jinfeng [1 ]
Zou, Guofeng [1 ]
Jeon, Gwanggil [1 ,3 ]
机构
[1] Shandong Univ Technol, Sch Elect & Elect Engn, Zibo 255000, Peoples R China
[2] Queen Mary Univ London, Sch Elect Engn & Comp Sci, London E1 4NS, England
[3] Incheon Natl Univ, Dept Embedded Syst Engn, Incheon 22012, South Korea
基金
中国国家自然科学基金;
关键词
super-resolution; remote sensing image; convolutional neural network; transformer; self-similarity; ALGORITHM;
D O I
10.3390/rs15133442
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Super-resolution (SR) technology plays a crucial role in improving the spatial resolution of remote sensing images so as to overcome the physical limitations of spaceborne imaging systems. Although deep convolutional neural networks have achieved promising results, most of them overlook the advantage of self-similarity information across different scales and high-dimensional features after the upsampling layers. To address the problem, we propose a hybrid-scale hierarchical transformer network (HSTNet) to achieve faithful remote sensing image SR. Specifically, we propose a hybrid-scale feature exploitation module to leverage the internal recursive information in single and cross scales within the images. To fully leverage the high-dimensional features and enhance discrimination, we designed a cross-scale enhancement transformer to capture long-range dependencies and efficiently calculate the relevance between high-dimension and low-dimension features. The proposed HSTNet achieves the best result in PSNR and SSIM with the UCMecred dataset and AID dataset. Comparative experiments demonstrate the effectiveness of the proposed methods and prove that the HSTNet outperforms the state-of-the-art competitors both in quantitative and qualitative evaluations.
引用
收藏
页数:20
相关论文
共 58 条
  • [1] [Anonymous], 2010, P ACM SIGSPATIAL INT
  • [2] A non-local algorithm for image denoising
    Buades, A
    Coll, B
    Morel, JM
    [J]. 2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, : 60 - 65
  • [3] Single image super-resolution using collaborative representation and non-local self-similarity
    Chang, Kan
    Ding, Pak Lun Kevin
    Li, Baoxin
    [J]. SIGNAL PROCESSING, 2018, 149 : 49 - 61
  • [4] Second-order Attention Network for Single Image Super-Resolution
    Dai, Tao
    Cai, Jianrui
    Zhang, Yongbing
    Xia, Shu-Tao
    Zhang, Lei
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11057 - 11066
  • [5] Accelerating the Super-Resolution Convolutional Neural Network
    Dong, Chao
    Loy, Chen Change
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 391 - 407
  • [6] Learning a Deep Convolutional Network for Image Super-Resolution
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 : 184 - 199
  • [7] A Hybrid Network of CNN and Transformer for Lightweight Image Super-Resolution
    Fang, Jinsheng
    Lin, Hanjiang
    Chen, Xinyu
    Zeng, Kun
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 1102 - 1111
  • [8] Image and Video Upscaling from Local Self-Examples
    Freedman, Gilad
    Fattal, Raanan
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2011, 30 (02):
  • [9] Label Placement Challenges in City Wayfinding Map Production-Identification and Possible Solutions
    Harrie, Lars
    Oucheikh, Rachid
    Nilsson, Asa
    Oxenstierna, Andreas
    Cederholm, Pontus
    Wei, Lai
    Richter, Kai-Florian
    Olsson, Perola
    [J]. JOURNAL OF GEOVISUALIZATION AND SPATIAL ANALYSIS, 2022, 6 (01)
  • [10] Remote Sensing Single-Image Superresolution Based on a Deep Compendium Model
    Haut, J. M.
    Paoletti, M. E.
    Fernandez-Beltran, R.
    Plaza, J.
    Plaza, A.
    Li, Jun
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (09) : 1432 - 1436