Lightweight vision Mamba for weather-degraded remote sensing image restoration

被引:0
作者
Li, Yufeng [1 ]
Wu, Shuang [1 ]
Chen, Hongming [2 ]
机构
[1] Shenyang Aerosp Univ, Coll Elect Informat Engn, Shenyang 110136, Peoples R China
[2] Dalian Maritime Univ, Coll Informat Sci & Technol, Dalian 116026, Peoples R China
关键词
Remote sensing; Image restoration; State space model; Mamba;
D O I
10.1007/s11760-024-03767-0
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the field of remote sensing, the acquired images are often severely degraded due to adverse weather conditions, such as haze and raindrops, posing significant challenges for subsequent visual tasks. Although CNN and Transformer have been widely applied to address these issues, they struggle to balance the relationship between global scene recovery, local detail preservation, and computational efficiency, leading to an imbalance between model performance and efficiency. To this end, we propose a lightweight and efficient visual state space model for remote sensing image restoration. Specifically, we propose the Efficient Vision Mamba Block as the core component of the model, incorporating the State Space Model to leverage its linear complexity for modeling long-range dependencies. Furthermore, we design a multi-router scanning strategy to perform global modeling of remote sensing images, capturing large spatial features from different routes and directions. Compared with existing methods that employ fixed-direction scanning, our approach avoids information redundancy caused by repeated scanning, making the model better adaptable to the complex and changeable weather conditions. Extensive experiments validate the superiority of our proposed model, outperforming state-of-the-art methods on both the StateHaze1k and UAV-Rain1k datasets.
引用
收藏
页数:9
相关论文
共 50 条
[41]   Restoration of color remote sensing image and its quality evaluation [J].
Zhang, ZX ;
Li, ZJ ;
Zhang, JQ ;
Wang, ZH .
THIRD INTERNATIONAL SYMPOSIUM ON MULTISPECTRAL IMAGE PROCESSING AND PATTERN RECOGNITION, PTS 1 AND 2, 2003, 5286 :10-15
[42]   MambaTriNet: A Mamba-Based Tribackbone Multimodal Remote Sensing Image Semantic Segmentation Model [J].
Ye, Famao ;
Tan, Shubin ;
Huang, Wenye ;
Xu, Xiaohua ;
Jiang, Shunliang .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2025, 22
[43]   Remote Sensing Image Restoration Method Based on Lorentz Fitting Point Spread Function [J].
Huang Guoxing ;
Liu Yipeng ;
Peng Hong ;
Lu Weidang ;
Wang Jingwen .
ACTA OPTICA SINICA, 2021, 41 (16)
[44]   HS remote sensing image restoration using fusion with MS images by EM algorithm [J].
Ansari, Amir ;
Danyali, Habibollah ;
Helfroush, Mohammad Sadegh .
IET SIGNAL PROCESSING, 2017, 11 (01) :95-103
[45]   A Lightweight Sparse Focus Transformer for Remote Sensing Image Change Captioning [J].
Sun, Dongwei ;
Bao, Yajie ;
Liu, Junmin ;
Cao, Xiangyong .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 :18727-18738
[46]   HC-Mamba: Remote Sensing Image Classification via Hybrid Cross-Activation State-Space Model [J].
Yang, Mo ;
Chen, Luo .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 :10429-10441
[47]   REMOTE SENSING IMAGE RESTORATION FOR ENVIRONMENTAL APPLICATIONS USING ESTIMATED PARAMETERS [J].
Lal, Anisha M. ;
Abdulla, Ali A. ;
Dennisan, Aju .
COMPTES RENDUS DE L ACADEMIE BULGARE DES SCIENCES, 2018, 71 (08) :1095-1101
[48]   A method for remote sensing image restoration based on the system degradation model [J].
Zhang, Pengfei ;
Gong, Jinnan ;
Jiang, Shikai ;
Shi, Tianjun ;
Yang, Jiawei ;
Bao, Guangzhen ;
Zhi, Xiyang .
RESULTS IN PHYSICS, 2024, 56
[49]   Leveraging Permuted Image Restoration for Improved Interpretation of Remote Sensing Images [J].
Bai, Awen ;
Chen, Jie ;
Yang, Wei ;
Men, Zhirong ;
Zhang, Shengming ;
Zeng, Hongcheng ;
Xu, Weichen ;
Cao, Jian .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 :1-15
[50]   Deep Multi-Scale Transformer for Remote Sensing Image Restoration [J].
Li, Yanting .
2024 5TH INTERNATIONAL CONFERENCE ON GEOLOGY, MAPPING AND REMOTE SENSING, ICGMRS 2024, 2024, :138-142