Spatiotemporal Enhancement and Interlevel Fusion Network for Remote Sensing Images Change Detection

被引:29
作者
Huang, Yanyuan [1 ]
Li, Xinghua [1 ,2 ]
Du, Zhengshun [1 ]
Shen, Huanfeng [3 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Hubei Luojia Lab, Wuhan 430079, Peoples R China
[3] Wuhan Univ, Sch Resource & Environm Sci, Wuhan 430079, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
关键词
Feature extraction; Spatiotemporal phenomena; Remote sensing; Decoding; Semantics; Location awareness; Deep learning; Change detection (CD); deep learning (DL); difference enhancement; feature fusion; remote sensing (RS); BUILDING CHANGE DETECTION; CONVOLUTIONAL NETWORK;
D O I
10.1109/TGRS.2024.3360516
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Remote sensing (RS) image change detection (CD) plays a crucial role in monitoring surface dynamics; however, current deep learning (DL)-based CD methods still suffer from pseudo changes and scale variations due to inadequate exploration of temporal differences and under-use of multiscale features. Based on the aforementioned considerations, a spatiotemporal enhancement and interlevel fusion network (SEIFNet) is proposed to improve the ability of feature representation for changing objects. First, the multilevel feature maps are acquired from the Siamese hierarchical backbone. To highlight the disparity in the same location at different times, the spatiotemporal difference enhancement modules (ST-DEMs) are introduced to capture global and local information from bitemporal feature maps at each level. Coordinate attention (CA) and cascaded convolutions are adopted in subtraction and connection branches, respectively. Then, an adaptive context fusion module (ACFM) is designed to integrate interlevel features under the guidance of different semantic information, constituting a progressive decoder. Additionally, a plain refinement module and a concise summation-based prediction head are employed to enhance the boundary details and internal integrity of CD results. The experimental results validate the superiority of our lightweight network over eight state-of-the-art (SOTA) methods on LEVIR-CD, SYSU-CD, and WHU-CD datasets, both in accuracy and efficiency. Also, the effects of different types of backbones and differential enhancement modules are discussed in the ablation experiments in detail. The code will be available at https://github.com/lixinghua5540/SEIFNet.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 55 条
[1]   Edge-Guided Recurrent Convolutional Neural Network for Multitemporal Remote Sensing Image Building Change Detection [J].
Bai, Beifang ;
Fu, Wei ;
Lu, Ting ;
Li, Shutao .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[2]   A TRANSFORMER-BASED SIAMESE NETWORK FOR CHANGE DETECTION [J].
Bandara, Wele Gedara Chaminda ;
Patel, Vishal M. .
2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, :207-210
[3]   Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and k-Means Clustering [J].
Celik, Turgay .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2009, 6 (04) :772-776
[4]   Remote Sensing Image Change Detection With Transformers [J].
Chen, Hao ;
Qi, Zipeng ;
Shi, Zhenwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[5]   A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection [J].
Chen, Hao ;
Shi, Zhenwei .
REMOTE SENSING, 2020, 12 (10)
[6]   EGDE-Net: A building change detection method for high-resolution remote sensing imagery based on edge guidance and differential enhancement [J].
Chen, Zhanlong ;
Zhou, Yuan ;
Wang, Bin ;
Xu, Xuwei ;
He, Nan ;
Jin, Shuai ;
Jin, Shenrui .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 191 :203-222
[7]   A hierarchical self-attention augmented Laplacian pyramid expanding network for change detection in high-resolution remote sensing images [J].
Cheng, Hongquan ;
Wu, Huayi ;
Zheng, Jie ;
Qi, Kunlun ;
Liu, Wenxuan .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 182 :52-66
[8]   DRMNet: Difference Image Reconstruction Enhanced Multiresolution Network for Optical Change Detection [J].
Chouhan, Avinash ;
Sur, Arijit ;
Chutia, Dibyajyoti .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 :4014-4026
[9]   Digital change detection methods in ecosystem monitoring: a review [J].
Coppin, P ;
Jonckheere, I ;
Nackaerts, K ;
Muys, B ;
Lambin, E .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2004, 25 (09) :1565-1596
[10]  
Dai XL, 1997, INT GEOSCI REMOTE SE, P1763, DOI 10.1109/IGARSS.1997.609062