Spatio-Temporal Feature Fusion and Guide Aggregation Network for Remote Sensing Change Detection

被引:2
|
作者
Wei, Hongguang [1 ]
Wang, Nan [2 ]
Liu, Yuan [1 ]
Ma, Pengge [3 ]
Pang, Dongdong [4 ]
Sui, Xiubao [1 ]
Chen, Qian [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Elect Engn & Optoelect Technol, Nanjing 210094, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing Key Lab Fract Signals & Syst, Beijing 100081, Peoples R China
[3] Zhengzhou Univ Aeronaut, Sch Intelligent Engn, Zhengzhou 450000, Peoples R China
[4] Beijing Informat Sci & Technol Univ, Sch Informat & Commun Engn, Beijing 100081, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Feature extraction; Transformers; Semantics; Image reconstruction; Remote sensing; Convolutional neural networks; Interference; Decoding; Noise; Convolution; Change detection; convolutional neural network (CNN); guide aggregation (GA); spatio-temporal feature fusion (STFF);
D O I
10.1109/TGRS.2024.3470314
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The field of remote sensing change detection (RSCD) has seen significant advancements recently, focusing on the precise identification and analysis of temporal changes in remote sensing images. Existing deep learning-based RSCD methods primarily rely on concatenation or subtraction to integrate features of bi-temporal images and reconstruct change features through a feature pyramid network (FPN) decoding architecture. However, these methods face challenges related to inadequate spatio-temporal change representation and insufficient aggregation of multilevel semantic information, resulting in pseudo-changes and poor completeness of detected change objects. In this article, we propose an innovative RSCD framework via spatio-temporal feature fusion and guide aggregation (STFF-GA) to address the aforementioned challenges. The architecture of this network comprises two key components: the STFF module and the GA module. The STFF module is designed as a low-parameter and low-computation structure, effectively enhancing the representation of spatio-temporal change information through split, interaction, and fusion strategies. The GA module uses deep feature guidance (DFG) mapping as prior information to guide the aggregation of multilevel semantic information, thereby correcting the positional information of change objects and filtering out pseudo-changes and other noise interference. In addition, it utilizes convolution kernels of various scales to extract fine-grained features, facilitating the complete reconstruction of change objects. Extensive experiments conducted on three benchmark change detection datasets demonstrate that the proposed STFF-GA consistently outperforms other state-of-the-art (SOTA) detectors. The code is available at https://github.com/NjustHGWei/STFF-GA.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] STNet: Spatial and Temporal feature fusion network for change detection in remote sensing images
    Ma, Xiaowen
    Yang, Jiawei
    Hong, Tingfeng
    Ma, Mengting
    Zhao, Ziyan
    Feng, Tian
    Zhang, Wei
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2195 - 2200
  • [2] Remote Sensing Change Detection Based on Multi scale Spatio-temporal Perceptual Attention Network
    Jia, Haoran
    Guo, Yongde
    2024 CROSS STRAIT RADIO SCIENCE AND WIRELESS TECHNOLOGY CONFERENCE, CSRSWTC 2024, 2024, : 102 - 104
  • [3] Joint Spatio-Temporal Modeling for Semantic Change Detection in Remote Sensing Images
    Ding, Lei
    Zhang, Jing
    Guo, Haitao
    Zhang, Kai
    Liu, Bing
    Bruzzone, Lorenzo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 14
  • [4] Multilevel feature aggregation and enhancement network for remote sensing change detection
    Yan, Wenkai
    Liu, Yikun
    Li, Mingsong
    Zhang, Ruifan
    Yang, Gongping
    JOURNAL OF APPLIED REMOTE SENSING, 2024, 18 (01)
  • [5] MLSTIF: multi-level spatio-temporal and human-object interaction feature fusion network for spatio-temporal action detection
    Rui Yang
    Hui Zhang
    Mulan Qiu
    Min Wang
    Multimedia Systems, 2025, 31 (3)
  • [6] A NOISE PROOF STRATEGY FOR SPATIO-TEMPORAL FUSION OF REMOTE SENSING IMAGERY
    Li, Yunfei
    Li, Jun
    Plaza, Antonio
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 895 - 898
  • [7] Spatio-temporal fusion for remote sensing data: an overview and new benchmark
    Li, Jun
    Li, Yunfei
    He, Lin
    Chen, Jin
    Plaza, Antonio
    SCIENCE CHINA-INFORMATION SCIENCES, 2020, 63 (04)
  • [8] Spatio-Temporal Data Fusion for Very Large Remote Sensing Datasets
    Hai Nguyen
    Katzfuss, Matthias
    Cressie, Noel
    Braverman, Amy
    TECHNOMETRICS, 2014, 56 (02) : 174 - 185
  • [9] Spatio-temporal fusion for remote sensing data: an overview and new benchmark
    Jun Li
    Yunfei Li
    Lin He
    Jin Chen
    Antonio Plaza
    Science China Information Sciences, 2020, 63
  • [10] Spatio-temporal fusion for remote sensing data:an overview and new benchmark
    Jun LI
    Yunfei LI
    Lin HE
    Jin CHEN
    Antonio PLAZA
    Science China(Information Sciences), 2020, 63 (04) : 7 - 23