Spatio-Temporal Feature Fusion and Guide Aggregation Network for Remote Sensing Change Detection

被引:2
|
作者
Wei, Hongguang [1 ]
Wang, Nan [2 ]
Liu, Yuan [1 ]
Ma, Pengge [3 ]
Pang, Dongdong [4 ]
Sui, Xiubao [1 ]
Chen, Qian [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Elect Engn & Optoelect Technol, Nanjing 210094, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing Key Lab Fract Signals & Syst, Beijing 100081, Peoples R China
[3] Zhengzhou Univ Aeronaut, Sch Intelligent Engn, Zhengzhou 450000, Peoples R China
[4] Beijing Informat Sci & Technol Univ, Sch Informat & Commun Engn, Beijing 100081, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Feature extraction; Transformers; Semantics; Image reconstruction; Remote sensing; Convolutional neural networks; Interference; Decoding; Noise; Convolution; Change detection; convolutional neural network (CNN); guide aggregation (GA); spatio-temporal feature fusion (STFF);
D O I
10.1109/TGRS.2024.3470314
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The field of remote sensing change detection (RSCD) has seen significant advancements recently, focusing on the precise identification and analysis of temporal changes in remote sensing images. Existing deep learning-based RSCD methods primarily rely on concatenation or subtraction to integrate features of bi-temporal images and reconstruct change features through a feature pyramid network (FPN) decoding architecture. However, these methods face challenges related to inadequate spatio-temporal change representation and insufficient aggregation of multilevel semantic information, resulting in pseudo-changes and poor completeness of detected change objects. In this article, we propose an innovative RSCD framework via spatio-temporal feature fusion and guide aggregation (STFF-GA) to address the aforementioned challenges. The architecture of this network comprises two key components: the STFF module and the GA module. The STFF module is designed as a low-parameter and low-computation structure, effectively enhancing the representation of spatio-temporal change information through split, interaction, and fusion strategies. The GA module uses deep feature guidance (DFG) mapping as prior information to guide the aggregation of multilevel semantic information, thereby correcting the positional information of change objects and filtering out pseudo-changes and other noise interference. In addition, it utilizes convolution kernels of various scales to extract fine-grained features, facilitating the complete reconstruction of change objects. Extensive experiments conducted on three benchmark change detection datasets demonstrate that the proposed STFF-GA consistently outperforms other state-of-the-art (SOTA) detectors. The code is available at https://github.com/NjustHGWei/STFF-GA.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Change Event Dataset for Discovery from Spatio-temporal Remote Sensing Imagery
    Mall, Utkarsh
    Hariharan, Bharath
    Bala, Kavita
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [22] Interactive spatio-temporal feature learning network for video foreground detection
    Hongrui Zhang
    Huan Li
    Complex & Intelligent Systems, 2022, 8 : 4251 - 4263
  • [23] Action recognition method of spatio-temporal feature fusion deep learning network
    Pei, Xiaomin
    Fan, Huijie
    Tang, Yandong
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2018, 47 (02):
  • [24] Interactive spatio-temporal feature learning network for video foreground detection
    Zhang, Hongrui
    Li, Huan
    COMPLEX & INTELLIGENT SYSTEMS, 2022, 8 (05) : 4251 - 4263
  • [25] Spatio-temporal fusion with motion masks for the moving small target detection from remote-sensing videos
    Zhu, Sicheng
    Ji, Luping
    Zhu, Jiewen
    Chen, Shengjia
    Ren, Haohao
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 138
  • [26] Foreground Object Detection in Visual Surveillance With Spatio-Temporal Fusion Network
    Kim, Jae-Yeul
    Ha, Jong-Eun
    IEEE ACCESS, 2022, 10 : 122857 - 122869
  • [27] Feature Guide Network With Context Aggregation Pyramid for Remote Sensing Image Segmentation
    Li, Jiaojiao
    Liu, Yuzhe
    Liu, Jiachao
    Song, Rui
    Liu, Wei
    Han, Kailiang
    Du, Qian
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 9900 - 9912
  • [28] Multichannel Spatio-Temporal Feature Fusion Method for NILM
    Feng, Jian
    Li, Keqin
    Zhang, Huaguang
    Zhang, Xinbo
    Yao, Yu
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (12) : 8735 - 8744
  • [29] Multiscale Difference Feature-Fusion Network for Change Detection With Hyperspectral Remote Sensing Images
    Lv, Zhiyong
    Wang, Haoran
    Li, Wei
    Zhang, Ming
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2025, 22
  • [30] Multi-scale feature progressive fusion network for remote sensing image change detection
    Lu, Di
    Cheng, Shuli
    Wang, Liejun
    Song, Shiji
    SCIENTIFIC REPORTS, 2022, 12 (01)