MsFNet: Multi-Scale Fusion Network Based on Dynamic Spectral Features for Multi-Temporal Hyperspectral Image Change Detection

被引:0
作者
Feng, Yining [1 ]
Ni, Weihan [2 ]
Song, Liyang [2 ]
Wang, Xianghai [1 ,2 ]
机构
[1] Liaoning Normal Univ, Sch Geog, Dalian 116029, Peoples R China
[2] Liaoning Normal Univ, Sch Comp Sci & Artificial Intelligence, Dalian 116029, Peoples R China
基金
中国国家自然科学基金;
关键词
change detection; deep learning; hyperspectral image; multi-scale feature; multi-temporal analysis; LAND-COVER;
D O I
10.3390/rs16163037
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
With the development of satellite technology, the importance of multi-temporal remote sensing (RS) image change detection (CD) in urban planning, environmental monitoring, and other fields is increasingly prominent. Deep learning techniques enable a profound exploration of the intrinsic features within hyperspectral (HS) data, leading to substantial enhancements in CD accuracy while addressing several challenges posed by traditional methodologies. However, existing convolutional neural network (CNN)-based CD approaches frequently encounter issues during the feature extraction process, such as the loss of detailed information due to downsampling, which hampers a model's ability to accurately capture complex spectral features. Additionally, these methods often neglect the integration of multi-scale information, resulting in suboptimal local feature extraction and, consequently, diminished model performance. To address these limitations, we propose a multi-scale fusion network (MsFNet) which leverages dynamic spectral features for effective multi-temporal HS-CD. Our approach incorporates a dynamic convolution module with spectral attention, which adaptively modulates the receptive field size according to the spectral characteristics of different bands. This flexibility enhances the model's capacity to focus on critical bands, thereby improving its ability to identify and differentiate changes across spectral dimensions. Furthermore, we develop a multi-scale feature fusion module which extracts and integrates features from deep feature maps, enriching local information and augmenting the model's sensitivity to local variations. Experimental evaluations conducted on three real-world HS-CD datasets demonstrate that the proposed MsFNet significantly outperforms contemporary advanced CD methods in terms of both efficacy and performance.
引用
收藏
页数:23
相关论文
共 50 条
  • [1] Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and k-Means Clustering
    Celik, Turgay
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2009, 6 (04) : 772 - 776
  • [2] Salt Structure Elastic Full Waveform Inversion Based on the Multiscale Signed Envelope
    Chen, Guoxin
    Yang, Wencai
    Liu, Yanan
    Wang, Hanchuang
    Huang, Xingguo
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [3] Deep Siamese Multi-scale Convolutional Network for Change Detection in Multi-temporal VHR Images
    Chen, Hongruixuan
    Wu, Chen
    Du, Bo
    Zhang, Liangpei
    [J]. 2019 10TH INTERNATIONAL WORKSHOP ON THE ANALYSIS OF MULTITEMPORAL REMOTE SENSING IMAGES (MULTITEMP), 2019,
  • [4] Efficient Seismic Data Denoising via Deep Learning With Improved MCA-SCUNet
    Chen, Jinxin
    Chen, Guoxin
    Li, Jun
    Du, Rongsen
    Qi, Yuli
    Li, ChunFeng
    Wang, Naijian
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 14
  • [5] Dynamic Convolution: Attention over Convolution Kernels
    Chen, Yinpeng
    Dai, Xiyang
    Liu, Mengchen
    Chen, Dongdong
    Yuan, Lu
    Liu, Zicheng
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, : 11027 - 11036
  • [6] PCA-based land-use change detection and analysis using multitemporal and multisensor satellite data
    Deng, J. S.
    Wang, K.
    Deng, Y. H.
    Qi, G. J.
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2008, 29 (16) : 4823 - 4838
  • [7] Local Information-Enhanced Graph-Transformer for Hyperspectral Image Change Detection With Limited Training Samples
    Dong, Wenqian
    Yang, Yufei
    Qu, Jiahui
    Xiao, Song
    Li, Yunsong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [8] Abundance Matrix Correlation Analysis Network Based on Hierarchical Multihead Self-Cross-Hybrid Attention for Hyperspectral Change Detection
    Dong, Wenqian
    Zhao, Jingyu
    Qu, Jiahui
    Xiao, Song
    Li, Nan
    Hou, Shaoxiong
    Li, Yunsong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [9] Unsupervised Deep Slow Feature Analysis for Change Detection in Multi-Temporal Remote Sensing Images
    Du, Bo
    Ru, Lixiang
    Wu, Chen
    Zhang, Liangpei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (12): : 9976 - 9992
  • [10] Information fusion techniques for change detection from multi-temporal remote sensing images
    Du, Peijun
    Liu, Sicong
    Xia, Junshi
    Zhao, Yindi
    [J]. INFORMATION FUSION, 2013, 14 (01) : 19 - 27