A Novel Remote Sensing Image Change Detection Approach Based on Multilevel State Space Model

被引:0
作者
Zhang, Zhongyu [1 ]
Fan, Xuanmei [1 ]
Wang, Xin [1 ]
Qin, Yingxiang [2 ]
Xia, Junshi [3 ]
机构
[1] Chengdu Univ Technol, State Key Lab Geohazard Prevent & Geoenvironm Prot, Chengdu 610059, Peoples R China
[2] Chengdu Univ Technol, Coll Geog & Planning, Chengdu 610059, Peoples R China
[3] RIKEN, Ctr Adv Intelligence Project AIP, Tokyo 1030027, Japan
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Transformers; Feature extraction; Computational modeling; Remote sensing; Convolution; Kernel; Data mining; Context modeling; Biological system modeling; Accuracy; Change detection (CD); high-resolution remote sensing image; large kernel convolution (LKC); state space model (SSM); VMamba; NETWORK; CLASSIFICATION;
D O I
10.1109/TGRS.2024.3501303
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Remote sensing image change detection (CD) is crucial for disaster assessment, land use change, and urban management. Most CD methods are realized by CNN and Transformer. However, these methods are not satisfied with modeling global dependencies while keeping a low computational complexity. Recently, the emergence of Mamba architectures based on state space models (SSMs) can remedy the above problems. In this article, we propose a visual Mamba-based multiscale feature extraction network to efficiently interactively fuse global and local information, which is named as MF-VMamba (MF: multiscale feature). First, a VMamba-based encoder is used to extract multiscale semantic features from bitemporal images. Then, a feature enhancement module (FEM) is proposed to capture the difference information between images. In addition, we employ a multilevel attention decoder (MAD) based on large kernel convolution (LKC) to obtain the information in spatial and spectral dimensions to realize the information interaction between global and local features. After the sequential processing of these three modules, the discriminative ability of changing objects is significantly improved. Notably, the computational complexity of our VMamba-based model grows linearly, which can significantly reduce the computational cost. In the experiments, our method performs well on CDD, DSIFN-CD, LEVIR-CD, and SYSU-CD datasets, with $F1$ scores and OA reaching $95.69\%/88.05\%/90.64\%{/86.95\%}$ and $98.97\%/96.01\%/99.07\%{/90.75\%}$ , respectively. The code can be accessed at https://github.com/121zzy/MF-Mamba.git.
引用
收藏
页数:14
相关论文
共 64 条
  • [1] Ban YF, 2016, REMOTE SENS DIGIT IM, V20, P19, DOI 10.1007/978-3-319-47037-5_2
  • [2] A TRANSFORMER-BASED SIAMESE NETWORK FOR CHANGE DETECTION
    Bandara, Wele Gedara Chaminda
    Patel, Vishal M.
    [J]. 2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 207 - 210
  • [3] Carion Nicolas, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12346), P213, DOI 10.1007/978-3-030-58452-8_13
  • [4] Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and k-Means Clustering
    Celik, Turgay
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2009, 6 (04) : 772 - 776
  • [5] Remote Sensing Image Change Detection With Transformers
    Chen, Hao
    Qi, Zipeng
    Shi, Zhenwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [6] A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection
    Chen, Hao
    Shi, Zhenwei
    [J]. REMOTE SENSING, 2020, 12 (10)
  • [7] Chen HRX, 2024, Arxiv, DOI arXiv:2404.03425
  • [8] Land-use/land-cover change detection using improved change-vector analysis
    Chen, J
    Gong, P
    He, CY
    Pu, RL
    Shi, PJ
    [J]. PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2003, 69 (04) : 369 - 379
  • [9] DASNet: Dual Attentive Fully Convolutional Siamese Networks for Change Detection in High-Resolution Satellite Images
    Chen, Jie
    Yuan, Ziyang
    Peng, Jian
    Chen, Li
    Huang, Haozhe
    Zhu, Jiawei
    Liu, Yu
    Li, Haifeng
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 1194 - 1206
  • [10] RSMamba: Remote Sensing Image Classification With State Space Model
    Chen, Keyan
    Chen, Bowen
    Liu, Chenyang
    Li, Wenyuan
    Zou, Zhengxia
    Shi, Zhenwei
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5