Spatio-Temporal Feature Fusion and Guide Aggregation Network for Remote Sensing Change Detection

被引:27
作者
Wei, Hongguang [1 ]
Wang, Nan [2 ]
Liu, Yuan [1 ]
Ma, Pengge [3 ]
Pang, Dongdong [4 ]
Sui, Xiubao [1 ]
Chen, Qian [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Elect Engn & Optoelect Technol, Nanjing 210094, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing Key Lab Fract Signals & Syst, Beijing 100081, Peoples R China
[3] Zhengzhou Univ Aeronaut, Sch Intelligent Engn, Zhengzhou 450000, Peoples R China
[4] Beijing Informat Sci & Technol Univ, Sch Informat & Commun Engn, Beijing 100081, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Feature extraction; Transformers; Semantics; Image reconstruction; Remote sensing; Convolutional neural networks; Interference; Decoding; Noise; Convolution; Change detection; convolutional neural network (CNN); guide aggregation (GA); spatio-temporal feature fusion (STFF);
D O I
10.1109/TGRS.2024.3470314
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The field of remote sensing change detection (RSCD) has seen significant advancements recently, focusing on the precise identification and analysis of temporal changes in remote sensing images. Existing deep learning-based RSCD methods primarily rely on concatenation or subtraction to integrate features of bi-temporal images and reconstruct change features through a feature pyramid network (FPN) decoding architecture. However, these methods face challenges related to inadequate spatio-temporal change representation and insufficient aggregation of multilevel semantic information, resulting in pseudo-changes and poor completeness of detected change objects. In this article, we propose an innovative RSCD framework via spatio-temporal feature fusion and guide aggregation (STFF-GA) to address the aforementioned challenges. The architecture of this network comprises two key components: the STFF module and the GA module. The STFF module is designed as a low-parameter and low-computation structure, effectively enhancing the representation of spatio-temporal change information through split, interaction, and fusion strategies. The GA module uses deep feature guidance (DFG) mapping as prior information to guide the aggregation of multilevel semantic information, thereby correcting the positional information of change objects and filtering out pseudo-changes and other noise interference. In addition, it utilizes convolution kernels of various scales to extract fine-grained features, facilitating the complete reconstruction of change objects. Extensive experiments conducted on three benchmark change detection datasets demonstrate that the proposed STFF-GA consistently outperforms other state-of-the-art (SOTA) detectors. The code is available at https://github.com/NjustHGWei/STFF-GA.
引用
收藏
页数:16
相关论文
共 61 条
[1]   A TRANSFORMER-BASED SIAMESE NETWORK FOR CHANGE DETECTION [J].
Bandara, Wele Gedara Chaminda ;
Patel, Vishal M. .
2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, :207-210
[2]   Earthquake Damage Assessment of Buildings Using VHR Optical and SAR Imagery [J].
Brunner, Dominik ;
Lemoine, Guido ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2010, 48 (05) :2403-2420
[3]   Remote Sensing Image Change Detection With Transformers [J].
Chen, Hao ;
Qi, Zipeng ;
Shi, Zhenwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[4]   A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection [J].
Chen, Hao ;
Shi, Zhenwei .
REMOTE SENSING, 2020, 12 (10)
[5]  
Daudt RC, 2018, IEEE IMAGE PROC, P4063, DOI 10.1109/ICIP.2018.8451652
[6]   PCA-based land-use change detection and analysis using multitemporal and multisensor satellite data [J].
Deng, J. S. ;
Wang, K. ;
Deng, Y. H. ;
Qi, G. J. .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2008, 29 (16) :4823-4838
[7]   ACNet: Strengthening the Kernel Skeletons for Powerful CNN via Asymmetric Convolution Blocks [J].
Ding, Xiaohan ;
Guo, Yuchen ;
Ding, Guiguang ;
Han, Jungong .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :1911-1920
[8]   Changer: Feature Interaction is What You Need for Change Detection [J].
Fang, Sheng ;
Li, Kaiyu ;
Li, Zhe .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
[9]   SNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR Images [J].
Fang, Sheng ;
Li, Kaiyu ;
Shao, Jinyuan ;
Li, Zhe .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[10]   A Lightweight Collective-attention Network for Change Detection [J].
Feng, Yuchao ;
Shao, Yanyan ;
Xu, Honghui ;
Xu, Jinshan ;
Zheng, Jianwei .
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, :8195-8203