MsFNet: Multi-Scale Fusion Network Based on Dynamic Spectral Features for Multi-Temporal Hyperspectral Image Change Detection

被引:0
作者
Feng, Yining [1 ]
Ni, Weihan [2 ]
Song, Liyang [2 ]
Wang, Xianghai [1 ,2 ]
机构
[1] Liaoning Normal Univ, Sch Geog, Dalian 116029, Peoples R China
[2] Liaoning Normal Univ, Sch Comp Sci & Artificial Intelligence, Dalian 116029, Peoples R China
基金
中国国家自然科学基金;
关键词
change detection; deep learning; hyperspectral image; multi-scale feature; multi-temporal analysis; LAND-COVER;
D O I
10.3390/rs16163037
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
With the development of satellite technology, the importance of multi-temporal remote sensing (RS) image change detection (CD) in urban planning, environmental monitoring, and other fields is increasingly prominent. Deep learning techniques enable a profound exploration of the intrinsic features within hyperspectral (HS) data, leading to substantial enhancements in CD accuracy while addressing several challenges posed by traditional methodologies. However, existing convolutional neural network (CNN)-based CD approaches frequently encounter issues during the feature extraction process, such as the loss of detailed information due to downsampling, which hampers a model's ability to accurately capture complex spectral features. Additionally, these methods often neglect the integration of multi-scale information, resulting in suboptimal local feature extraction and, consequently, diminished model performance. To address these limitations, we propose a multi-scale fusion network (MsFNet) which leverages dynamic spectral features for effective multi-temporal HS-CD. Our approach incorporates a dynamic convolution module with spectral attention, which adaptively modulates the receptive field size according to the spectral characteristics of different bands. This flexibility enhances the model's capacity to focus on critical bands, thereby improving its ability to identify and differentiate changes across spectral dimensions. Furthermore, we develop a multi-scale feature fusion module which extracts and integrates features from deep feature maps, enriching local information and augmenting the model's sensitivity to local variations. Experimental evaluations conducted on three real-world HS-CD datasets demonstrate that the proposed MsFNet significantly outperforms contemporary advanced CD methods in terms of both efficacy and performance.
引用
收藏
页数:23
相关论文
共 50 条
  • [21] CBANet: An End-to-End Cross-Band 2-D Attention Network for Hyperspectral Change Detection in Remote Sensing
    Li, Yinhe
    Ren, Jinchang
    Yan, Yijun
    Liu, Qiaoyuan
    Ma, Ping
    Petrovski, Andrei
    Sun, Haijiang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [22] A Review of Change Detection in Multitemporal Hyperspectral Images Current techniques, applications, and challenges
    Liu, Sicong
    Marinelli, Daniele
    Bruzzone, Lorenzo
    Bovolo, Francesca
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2019, 7 (02): : 140 - 158
  • [23] Multi-scale feature progressive fusion network for remote sensing image change detection
    Lu, Di
    Cheng, Shuli
    Wang, Liejun
    Song, Shiji
    [J]. SCIENTIFIC REPORTS, 2022, 12 (01)
  • [24] Multiscale Diff-Changed Feature Fusion Network for Hyperspectral Image Change Detection
    Luo, Fulin
    Zhou, Tianyuan
    Liu, Jiamin
    Guo, Tan
    Gong, Xiuwen
    Ren, Jinchang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [25] Learning a Transferable Change Rule from a Recurrent Neural Network for Land Cover Change Detection
    Lyu, Haobo
    Lu, Hui
    Mou, Lichao
    [J]. REMOTE SENSING, 2016, 8 (06)
  • [26] Moustafa MS, 2021, J APPL REMOTE SENS, V15, DOI [10.1117/IIRS.15.028505, 10.1117/1.JRS.15.028505]
  • [27] Multiple support vector machines for land cover change detection: An application for mapping urban extensions
    Nemmour, Hassiba
    Chibani, Youcef
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2006, 61 (02) : 125 - 133
  • [28] Deep Learning-Based Change Detection in Remote Sensing Images: A Review
    Shafique, Ayesha
    Cao, Guo
    Khan, Zia
    Asad, Muhammad
    Aslam, Muhammad
    [J]. REMOTE SENSING, 2022, 14 (04)
  • [29] Change Detection Based on Artificial Intelligence: State-of-the-Art and Challenges
    Shi, Wenzhong
    Zhang, Min
    Zhang, Rui
    Chen, Shanxiong
    Zhan, Zhao
    [J]. REMOTE SENSING, 2020, 12 (10)
  • [30] Change Detection in Hyperspectral Images Using Recurrent 3D Fully Convolutional Networks
    Song, Ahram
    Choi, Jaewan
    Han, Youkyung
    Kim, Yongil
    [J]. REMOTE SENSING, 2018, 10 (11)