EHAT:Enhanced Hybrid Attention Transformer for Remote Sensing Image Super-Resolution

被引:0
作者
Wang, Jian [1 ]
Xie, Zexin [1 ]
Du, Yanlin [1 ]
Song, Wei [1 ]
机构
[1] Shanghai Ocean Univ, Coll Informat Technol, Shanghai, Peoples R China
来源
PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VIII | 2025年 / 15038卷
关键词
Vison Transformer; remote sensing; self attention; super resolution; Nonlocal neural Network;
D O I
10.1007/978-981-97-8685-5_16
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, deep learning (DL)-based super-resolution techniques for remote sensing images have made significant progress. However, these models have constraints in effectively managing long-range non-local information and reusing features, while also encountering issues such as gradient vanishing and explosion. To overcome these challenges, we propose the Enhanced Hybrid Attention Transformer (EHAT) framework, which is based on the Hybrid Attention Transformer (HAT) network backbone and combines a region-level nonlocal neural network block and a skip fusion network SFN to form a new skip fusion attention group (SFAG). In addition, we form a Multi-attention Block (MAB) by introducing spatial frequency block (SFB) based on fast Fourier convolution. We have conducted extensive experiments on Uc Merced, CLRS and RSSCN7 datasets. The results show that our method improves the PSNR by about 0.2 dB on Uc Mercedx4.
引用
收藏
页码:225 / 237
页数:13
相关论文
共 50 条
[31]   REMOTE SENSING IMAGE SUPER-RESOLUTION WITH TOP-K TOKEN SELECTIVE TRANSFORMER [J].
Xiao, Yi ;
Yuan, Qiangqiang .
IGARSS 2024-2024 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, IGARSS 2024, 2024, :3159-3162
[32]   Activated Sparsely Sub-Pixel Transformer for Remote Sensing Image Super-Resolution [J].
Guo, Yongde ;
Gong, Chengying ;
Yan, Jun .
REMOTE SENSING, 2024, 16 (11)
[33]   TRANSFORMER AND CNN HYBRID NETWORK FOR SUPER-RESOLUTION SEMANTIC SEGMENTATION OF REMOTE SENSING IMAGERY [J].
Liu, Yutong ;
Gao, Kun ;
Wang, Hong ;
Wang, Junwei ;
Zhang, Xiaodian ;
Wang, Pengyu ;
Li, Shuzhong .
IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, :6940-6943
[34]   Remote Sensing Image Super-Resolution via Dual-Resolution Network Based on Connected Attention Mechanism [J].
Zhang, Xiangrong ;
Li, Zhenyu ;
Zhang, Tianyang ;
Liu, Fengsheng ;
Tang, Xu ;
Chen, Puhua ;
Jiao, Licheng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[35]   SWCGAN: Generative Adversarial Network Combining Swin Transformer and CNN for Remote Sensing Image Super-Resolution [J].
Tu, Jingzhi ;
Mei, Gang ;
Ma, Zhengjing ;
Piccialli, Francesco .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 :5662-5673
[36]   HyDA-Net: A Hybrid Dense Attention Network for Remote Sensing Multi-Image Super-Resolution [J].
Ibrahim, Mohamed Ramzy ;
Benavente, Robert ;
Ponsa, Daniel ;
Lumbreras, Felipe .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 :7592-7614
[37]   Hybrid-Scale Self-Similarity Exploitation for Remote Sensing Image Super-Resolution [J].
Lei, Sen ;
Shi, Zhenwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[38]   Deep Learning for Remote Sensing Image Super-Resolution [J].
Ul Hoque, Md Reshad ;
Burks, Roland, III ;
Kwan, Chiman ;
Li, Jiang .
2019 IEEE 10TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2019, :286-292
[39]   TRANSCYCLEGAN: AN APPROACH FOR REMOTE SENSING IMAGE SUPER-RESOLUTION [J].
Zhai, Lujun ;
Wang, Yonghui ;
Cui, Suxia ;
Zhou, Yu .
2024 IEEE SOUTHWEST SYMPOSIUM ON IMAGE ANALYSIS AND INTERPRETATION, SSIAI, 2024, :61-64
[40]   Attention-based multi-image super-resolution reconstruction for remote sensing [J].
Ding, Xueyan ;
Wang, Wenshan ;
Zhang, Bingbing ;
Zhang, Jianxin .
SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (06)