Lightweight vision Mamba for weather-degraded remote sensing image restoration

被引:0
作者
Li, Yufeng [1 ]
Wu, Shuang [1 ]
Chen, Hongming [2 ]
机构
[1] Shenyang Aerosp Univ, Coll Elect Informat Engn, Shenyang 110136, Peoples R China
[2] Dalian Maritime Univ, Coll Informat Sci & Technol, Dalian 116026, Peoples R China
关键词
Remote sensing; Image restoration; State space model; Mamba;
D O I
10.1007/s11760-024-03767-0
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the field of remote sensing, the acquired images are often severely degraded due to adverse weather conditions, such as haze and raindrops, posing significant challenges for subsequent visual tasks. Although CNN and Transformer have been widely applied to address these issues, they struggle to balance the relationship between global scene recovery, local detail preservation, and computational efficiency, leading to an imbalance between model performance and efficiency. To this end, we propose a lightweight and efficient visual state space model for remote sensing image restoration. Specifically, we propose the Efficient Vision Mamba Block as the core component of the model, incorporating the State Space Model to leverage its linear complexity for modeling long-range dependencies. Furthermore, we design a multi-router scanning strategy to perform global modeling of remote sensing images, capturing large spatial features from different routes and directions. Compared with existing methods that employ fixed-direction scanning, our approach avoids information redundancy caused by repeated scanning, making the model better adaptable to the complex and changeable weather conditions. Extensive experiments validate the superiority of our proposed model, outperforming state-of-the-art methods on both the StateHaze1k and UAV-Rain1k datasets.
引用
收藏
页数:9
相关论文
共 50 条
[31]   Deep Memory Connected Neural Network for Optical Remote Sensing Image Restoration [J].
Xu, Wenjia ;
Xu, Guangluan ;
Wang, Yang ;
Sun, Xian ;
Lin, Daoyu ;
Wu, Yirong .
REMOTE SENSING, 2018, 10 (12)
[32]   Remote sensing for restoration ecology: Application for restoring degraded, damaged, transformed, or destroyed ecosystems [J].
Reif, Molly K. ;
Theel, Heather J. .
INTEGRATED ENVIRONMENTAL ASSESSMENT AND MANAGEMENT, 2017, 13 (04) :614-630
[33]   A method for remote sensing image restoration using gyroscope sensor [J].
Wu Wenshuang ;
Feng Huajun ;
He Lirong ;
Xu Zhihai ;
Li Qi ;
Chen Yueting ;
Yang Chenwei ;
Zheng Zhenzhen .
AOPC 2017: OPTICAL SENSING AND IMAGING TECHNOLOGY AND APPLICATIONS, 2017, 10462
[34]   Restoration of color remote sensing image and its quality evaluation [J].
Zhang, ZX ;
Li, ZJ ;
Zhang, JQ ;
Wang, ZH .
THIRD INTERNATIONAL SYMPOSIUM ON MULTISPECTRAL IMAGE PROCESSING AND PATTERN RECOGNITION, PTS 1 AND 2, 2003, 5286 :10-15
[35]   Remote Sensing Image Restoration Method Based on Lorentz Fitting Point Spread Function [J].
Huang Guoxing ;
Liu Yipeng ;
Peng Hong ;
Lu Weidang ;
Wang Jingwen .
ACTA OPTICA SINICA, 2021, 41 (16)
[36]   HS remote sensing image restoration using fusion with MS images by EM algorithm [J].
Ansari, Amir ;
Danyali, Habibollah ;
Helfroush, Mohammad Sadegh .
IET SIGNAL PROCESSING, 2017, 11 (01) :95-103
[37]   A Lightweight Sparse Focus Transformer for Remote Sensing Image Change Captioning [J].
Sun, Dongwei ;
Bao, Yajie ;
Liu, Junmin ;
Cao, Xiangyong .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 :18727-18738
[38]   RS3Mamba: Visual State Space Model for Remote Sensing Image Semantic Segmentation [J].
Ma, Xianping ;
Zhang, Xiaokang ;
Pun, Man-On .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
[39]   REMOTE SENSING IMAGE RESTORATION FOR ENVIRONMENTAL APPLICATIONS USING ESTIMATED PARAMETERS [J].
Lal, Anisha M. ;
Abdulla, Ali A. ;
Dennisan, Aju .
COMPTES RENDUS DE L ACADEMIE BULGARE DES SCIENCES, 2018, 71 (08) :1095-1101
[40]   A method for remote sensing image restoration based on the system degradation model [J].
Zhang, Pengfei ;
Gong, Jinnan ;
Jiang, Shikai ;
Shi, Tianjun ;
Yang, Jiawei ;
Bao, Guangzhen ;
Zhi, Xiyang .
RESULTS IN PHYSICS, 2024, 56