STADE-CDNet: Spatial–Temporal Attention With Difference Enhancement-Based Network for Remote Sensing Image Change Detection

被引:0
作者
Li, Zhi [1 ,2 ]
Cao, Siying [1 ,2 ]
Deng, Jiakun [1 ,2 ]
Wu, Fengyi [1 ,2 ]
Wang, Ruilan [1 ,2 ]
Luo, Junhai [1 ,2 ]
Peng, Zhenming [1 ,2 ]
机构
[1] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 610054, Peoples R China
[2] Univ Elect Sci & Technol China, Lab Imaging Detect & Intelligent Percept, Chengdu 610054, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
关键词
Transformers; Feature extraction; Data mining; Semantics; Deep learning; Remote sensing; Memory modules; Change detection (CD) difference enhancement; multitemporal image pairs; temporal memory; transformer; CONVOLUTIONAL NETWORK;
D O I
10.1109/TGRS.2024.3367948
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
High-resolution remote sensing (RS) image change detection (CD) focuses on ground surface changes. It has wide applications, including territorial spatial planning, urban region detection, and military operations. However, class imbalance and pseudochanges are caused by the unchanged areas far outnumbering the changed areas and lighting changes. To address these problems, we propose spatial-temporal attention with a difference enhancement-based network (STADE-CDNet). In STADE-CDNet, a CD difference enhancement module (CDDM) is proposed to extract important features from the difference map to detect changed regions. This module enhances the network with differential feature attributes through the training layer, improving the network's learning ability and reducing the imbalance problem. A temporal memory module (TMM) is designed to extract temporal and spatial information. Inspired by the self-attention mechanism of the transformer, we propose a transformer and TMM (TTMM). Four encoding layers are designed to detect the semantic information from high to low levels of the multitemporal image pairs. The fusion and parallelism of multivariate data are achieved through collaborative modeling of deep learning and CD, compensating for the need for excessive human intervention in traditional algorithms. We evaluate our approach in two different datasets [LEVIR building CD (LEVIR-CD) and deeply supervised image fusion network for change detection (DSIFN-CD)]. Promising quantitative and qualitative results show that the STADE-CDNet can improve accuracy. In particular, the proposed CDDM significantly reduces false positive detection, with F1 scores at least 1.97% and 2.1% higher than other methods in the case of the LEVIR-CD and DSIFN-CD datasets, respectively. Our code is available at https://github.com/LiLisaZhi/STADE-CDNet.
引用
收藏
页码:1 / 17
页数:17
相关论文
共 50 条
  • [31] RAIH-Det: An End-to-End Rotated Aircraft and Aircraft Head Detector Based on ConvNeXt and Cyclical Focal Loss in Optical Remote Sensing Images
    Song, Fei
    Ma, Ruofei
    Lei, Tao
    Peng, Zhenming
    [J]. REMOTE SENSING, 2023, 15 (09)
  • [32] L-UNet: An LSTM Network for Remote Sensing Image Change Detection
    Sun, Shuting
    Mu, Lin
    Wang, Lizhe
    Liu, Peng
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [33] Vaswani A, 2017, ADV NEUR IN, V30
  • [34] E2SCNet: Efficient Multiobjective Evolutionary Automatic Search for Remote Sensing Image Scene Classification Network Architecture
    Wan, Yuting
    Zhong, Yanfei
    Ma, Ailong
    Wang, Junjue
    Zhang, Liangpei
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (06) : 7752 - 7766
  • [35] Adaptive Feature Weighted Fusion Nested U-Net with Discrete Wavelet Transform for Change Detection of High-Resolution Remote Sensing Images
    Wang, Congcong
    Sun, Wenbin
    Fan, Deqin
    Liu, Xiaoding
    Zhang, Zhi
    [J]. REMOTE SENSING, 2021, 13 (24)
  • [36] Wood S., 2021, Slow momentum with fast reversion: A trading strategy using deep learning and change point detection
  • [37] Unsupervised Change Detection in Multitemporal VHR Images Based on Deep Kernel PCA Convolutional Mapping Network
    Wu, Chen
    Chen, Hongruixuan
    Du, Bo
    Zhang, Liangpei
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (11) : 12084 - 12098
  • [38] An object-based graph model for unsupervised change detection in high resolution remote sensing images
    Wu, Junzheng
    Li, Biao
    Qin, Yao
    Ni, Weiping
    Zhang, Han
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2021, 42 (16) : 6212 - 6230
  • [39] Yan Tianyu, 2022, P AS C COMP VIS, P1691
  • [40] Yun S., 2022, IEEE Geosci. RemoteSens. Lett., V19, P1