MsFNet: Multi-Scale Fusion Network Based on Dynamic Spectral Features for Multi-Temporal Hyperspectral Image Change Detection

被引:0
作者
Feng, Yining [1 ]
Ni, Weihan [2 ]
Song, Liyang [2 ]
Wang, Xianghai [1 ,2 ]
机构
[1] Liaoning Normal Univ, Sch Geog, Dalian 116029, Peoples R China
[2] Liaoning Normal Univ, Sch Comp Sci & Artificial Intelligence, Dalian 116029, Peoples R China
基金
中国国家自然科学基金;
关键词
change detection; deep learning; hyperspectral image; multi-scale feature; multi-temporal analysis; LAND-COVER;
D O I
10.3390/rs16163037
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
With the development of satellite technology, the importance of multi-temporal remote sensing (RS) image change detection (CD) in urban planning, environmental monitoring, and other fields is increasingly prominent. Deep learning techniques enable a profound exploration of the intrinsic features within hyperspectral (HS) data, leading to substantial enhancements in CD accuracy while addressing several challenges posed by traditional methodologies. However, existing convolutional neural network (CNN)-based CD approaches frequently encounter issues during the feature extraction process, such as the loss of detailed information due to downsampling, which hampers a model's ability to accurately capture complex spectral features. Additionally, these methods often neglect the integration of multi-scale information, resulting in suboptimal local feature extraction and, consequently, diminished model performance. To address these limitations, we propose a multi-scale fusion network (MsFNet) which leverages dynamic spectral features for effective multi-temporal HS-CD. Our approach incorporates a dynamic convolution module with spectral attention, which adaptively modulates the receptive field size according to the spectral characteristics of different bands. This flexibility enhances the model's capacity to focus on critical bands, thereby improving its ability to identify and differentiate changes across spectral dimensions. Furthermore, we develop a multi-scale feature fusion module which extracts and integrates features from deep feature maps, enriching local information and augmenting the model's sensitivity to local variations. Experimental evaluations conducted on three real-world HS-CD datasets demonstrate that the proposed MsFNet significantly outperforms contemporary advanced CD methods in terms of both efficacy and performance.
引用
收藏
页数:23
相关论文
共 50 条
  • [11] UNMIXING WITH SLIC SUPERPIXELS FOR HYPERSPECTRAL CHANGE DETECTION
    Erturk, Alp
    Erturk, Sarp
    Plaza, Antonio
    [J]. 2016 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2016, : 3370 - 3373
  • [12] Guo QL, 2017, INT GEOSCI REMOTE SE, P1919, DOI 10.1109/IGARSS.2017.8127353
  • [13] Hyperspectral change detection: an experimental comparative study
    Hasanlou, Mahdi
    Seydi, Seyd Teymoor
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2018, 39 (20) : 7029 - 7083
  • [14] Hyperspectral Change Detection Based on Multiple Morphological Profiles
    Hou, Zengfu
    Li, Wei
    Li, Lu
    Tao, Ran
    Du, Qian
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [15] Ioffe S., 2015, International Conference on Machine Learning (PMLR), P448
  • [16] Uncertainty-Aware Graph Self-Supervised Learning for Hyperspectral Image Change Detection
    Jian, Ping
    Ou, Yimin
    Chen, Keming
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 19
  • [17] Change vector analysis: a technique for the multispectral monitoring of land cover and condition
    Johnson, RD
    Kasischke, ES
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 1998, 19 (03) : 411 - 426
  • [18] Automatic change detection by evidential fusion of change indices
    Le Hégarat-Mascle, S
    Seltz, R
    [J]. REMOTE SENSING OF ENVIRONMENT, 2004, 91 (3-4) : 390 - 404
  • [19] Classification of Hyperspectral Image Based on Double-Branch Dual-Attention Mechanism Network
    Li, Rui
    Zheng, Shunyi
    Duan, Chenxi
    Yang, Yang
    Wang, Xiqi
    [J]. REMOTE SENSING, 2020, 12 (03)
  • [20] ConvTransNet: A CNN-Transformer Network for Change Detection With Multiscale Global-Local Representations
    Li, Weiming
    Xue, Lihui
    Wang, Xueqian
    Li, Gang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61