Lightweight vision Mamba for weather-degraded remote sensing image restoration

被引:0
作者
Li, Yufeng [1 ]
Wu, Shuang [1 ]
Chen, Hongming [2 ]
机构
[1] Shenyang Aerosp Univ, Coll Elect Informat Engn, Shenyang 110136, Peoples R China
[2] Dalian Maritime Univ, Coll Informat Sci & Technol, Dalian 116026, Peoples R China
关键词
Remote sensing; Image restoration; State space model; Mamba;
D O I
10.1007/s11760-024-03767-0
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the field of remote sensing, the acquired images are often severely degraded due to adverse weather conditions, such as haze and raindrops, posing significant challenges for subsequent visual tasks. Although CNN and Transformer have been widely applied to address these issues, they struggle to balance the relationship between global scene recovery, local detail preservation, and computational efficiency, leading to an imbalance between model performance and efficiency. To this end, we propose a lightweight and efficient visual state space model for remote sensing image restoration. Specifically, we propose the Efficient Vision Mamba Block as the core component of the model, incorporating the State Space Model to leverage its linear complexity for modeling long-range dependencies. Furthermore, we design a multi-router scanning strategy to perform global modeling of remote sensing images, capturing large spatial features from different routes and directions. Compared with existing methods that employ fixed-direction scanning, our approach avoids information redundancy caused by repeated scanning, making the model better adaptable to the complex and changeable weather conditions. Extensive experiments validate the superiority of our proposed model, outperforming state-of-the-art methods on both the StateHaze1k and UAV-Rain1k datasets.
引用
收藏
页数:9
相关论文
共 50 条
[21]   Influence of Space Variability on Remote Sensing Image Restoration Performances [J].
Jiang, Shikai ;
Zhi, Xiyang ;
Shi, Tianjun ;
Hu, Jianming ;
Zhang, Wei ;
Gong, Jinnan .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[22]   A Mamba-Diffusion Framework for Multimodal Remote Sensing Image Semantic Segmentation [J].
Du, Wen-Liang ;
Gu, Yang ;
Zhao, Jiaqi ;
Zhu, Hancheng ;
Yao, Rui ;
Zhou, Yong .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
[23]   Vision Transformers for Remote Sensing Image Classification [J].
Bazi, Yakoub ;
Bashmal, Laila ;
Rahhal, Mohamad M. Al ;
Dayil, Reham Al ;
Ajlan, Naif Al .
REMOTE SENSING, 2021, 13 (03) :1-20
[24]   Mamba Collaborative Implicit Neural Representation for Hyperspectral and Multispectral Remote Sensing Image Fusion [J].
Zhu, Chunyu ;
Deng, Shangqi ;
Song, Xuan ;
Li, Yachao ;
Wang, Qi .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
[25]   High-Resolution, Lightweight Remote Sensing via Harmonic Diffractive Optical Imaging Systems and Deep Denoiser Prior Image Restoration [J].
Zhong, Shuo ;
Zhao, Xijun ;
Liu, Dun ;
Su, Haibing ;
Xie, Zongliang ;
Fan, Bin .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 :1-17
[26]   Restoration of Hyperspectral Remote Sensing Image Based on MTF [J].
Wu Wenbin ;
Zhao Xuejun .
2012 INTERNATIONAL SYMPOSIUM ON INFORMATION SCIENCE AND ENGINEERING (ISISE), 2012, :445-448
[27]   MambaFormerSR: A Lightweight Model for Remote-Sensing Image Super-Resolution [J].
Zhi, Ruicong ;
Fan, Xiaopei ;
Shi, Jingye .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
[28]   CloudViT: A Lightweight Vision Transformer Network for Remote Sensing Cloud Detection [J].
Zhang, Bin ;
Zhang, Yongjun ;
Li, Yansheng ;
Wan, Yi ;
Yao, Yongxiang .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
[29]   CloudViT: A Lightweight Vision Transformer Network for Remote Sensing Cloud Detection [J].
Zhang, Bin ;
Zhang, Yongjun ;
Li, Yansheng ;
Wan, Yi ;
Yao, Yongxiang .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
[30]   A Lightweight and Multiscale Network for Remote Sensing Image Scene Classification [J].
Bai, Lin ;
Liu, Qingxin ;
Li, Cuiling ;
Zhu, Chunlin ;
Ye, Zhen ;
Xi, Meng .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19