STADE-CDNet: Spatial–Temporal Attention With Difference Enhancement-Based Network for Remote Sensing Image Change Detection

被引:0
作者
Li, Zhi [1 ,2 ]
Cao, Siying [1 ,2 ]
Deng, Jiakun [1 ,2 ]
Wu, Fengyi [1 ,2 ]
Wang, Ruilan [1 ,2 ]
Luo, Junhai [1 ,2 ]
Peng, Zhenming [1 ,2 ]
机构
[1] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 610054, Peoples R China
[2] Univ Elect Sci & Technol China, Lab Imaging Detect & Intelligent Percept, Chengdu 610054, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
关键词
Transformers; Feature extraction; Data mining; Semantics; Deep learning; Remote sensing; Memory modules; Change detection (CD) difference enhancement; multitemporal image pairs; temporal memory; transformer; CONVOLUTIONAL NETWORK;
D O I
10.1109/TGRS.2024.3367948
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
High-resolution remote sensing (RS) image change detection (CD) focuses on ground surface changes. It has wide applications, including territorial spatial planning, urban region detection, and military operations. However, class imbalance and pseudochanges are caused by the unchanged areas far outnumbering the changed areas and lighting changes. To address these problems, we propose spatial-temporal attention with a difference enhancement-based network (STADE-CDNet). In STADE-CDNet, a CD difference enhancement module (CDDM) is proposed to extract important features from the difference map to detect changed regions. This module enhances the network with differential feature attributes through the training layer, improving the network's learning ability and reducing the imbalance problem. A temporal memory module (TMM) is designed to extract temporal and spatial information. Inspired by the self-attention mechanism of the transformer, we propose a transformer and TMM (TTMM). Four encoding layers are designed to detect the semantic information from high to low levels of the multitemporal image pairs. The fusion and parallelism of multivariate data are achieved through collaborative modeling of deep learning and CD, compensating for the need for excessive human intervention in traditional algorithms. We evaluate our approach in two different datasets [LEVIR building CD (LEVIR-CD) and deeply supervised image fusion network for change detection (DSIFN-CD)]. Promising quantitative and qualitative results show that the STADE-CDNet can improve accuracy. In particular, the proposed CDDM significantly reduces false positive detection, with F1 scores at least 1.97% and 2.1% higher than other methods in the case of the LEVIR-CD and DSIFN-CD datasets, respectively. Our code is available at https://github.com/LiLisaZhi/STADE-CDNet.
引用
收藏
页码:1 / 17
页数:17
相关论文
共 50 条
  • [1] [Anonymous], 2023, Int. J. Remote Sens., V44, P6033, DOI [10.1080/01431161.2023.2258563, DOI 10.1080/01431161.2023.2258563]
  • [2] A TRANSFORMER-BASED SIAMESE NETWORK FOR CHANGE DETECTION
    Bandara, Wele Gedara Chaminda
    Patel, Vishal M.
    [J]. 2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 207 - 210
  • [3] Adversarial Instance Augmentation for Building Change Detection in Remote Sensing Images
    Chen, Hao
    Li, Wenyuan
    Shi, Zhenwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] Remote Sensing Image Change Detection With Transformers
    Chen, Hao
    Qi, Zipeng
    Shi, Zhenwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [5] A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection
    Chen, Hao
    Shi, Zhenwei
    [J]. REMOTE SENSING, 2020, 12 (10)
  • [6] GasHis-Transformer: A multi-scale visual transformer approach for gastric histopathological image detection
    Chen, Haoyuan
    Li, Chen
    Wang, Ge
    Li, Xiaoyan
    Rahaman, Md Mamunur
    Sun, Hongzan
    Hu, Weiming
    Li, Yixin
    Liu, Wanli
    Sun, Changhao
    Ai, Shiliang
    Grzegorzek, Marcin
    [J]. PATTERN RECOGNITION, 2022, 130
  • [7] A Mutual Information Domain Adaptation Network for Remotely Sensed Semantic Segmentation
    Chen, Hongyu
    Zhang, Hongyan
    Yang, Guangyi
    Li, Shengyang
    Zhang, Liangpei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [8] Chen Y. Wan, 2022, IEEE Trans. Geosci. Remote Sens., V60, DOI 10.1109/TGRS.2022.3216685.[4]M.
  • [9] TINYCD: a (not so) deep learning model for change detection
    Codegoni, Andrea
    Lombardi, Gabriele
    Ferrari, Alessandro
    [J]. NEURAL COMPUTING & APPLICATIONS, 2023, 35 (11) : 8471 - 8486
  • [10] Daudt RC, 2018, IEEE IMAGE PROC, P4063, DOI 10.1109/ICIP.2018.8451652