AMFNet: Attention-Guided Multi-Scale Fusion Network for Bi-Temporal Change Detection in Remote Sensing Images

被引:8
作者
Zhan, Zisen [1 ]
Ren, Hongjin [1 ]
Xia, Min [1 ]
Lin, Haifeng [2 ]
Wang, Xiaoya [1 ,3 ]
Li, Xin [2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Collaborat Innovat Ctr Atmospher Environm & Equipm, Nanjing 210044, Peoples R China
[2] Nanjing Forestry Univ, Coll Informat Sci & Technol, Nanjing 210000, Peoples R China
[3] Univ Reading, Dept Comp Sci, Reading RG6 6DH, England
关键词
change detection; remote sensing image; deep learning; multi-scale supervised; USE/LAND-COVER CHANGE; URBAN EXPANSION; OPTICAL-IMAGES; SAR;
D O I
10.3390/rs16101765
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Change detection is crucial for evaluating land use, land cover changes, and sustainable development, constituting a significant component of Earth observation tasks. The difficulty in extracting features from high-resolution images, coupled with the complexity of image content, poses challenges for traditional change detection algorithms in terms of accuracy and applicability. The recent emergence of deep learning methods has led to substantial progress in the field of change detection. However, existing frameworks often involve the simplistic integration of bi-temporal features in specific areas, lacking the fusion of temporal information and semantic details in the images. In this paper, we propose an attention-guided multi-scale fusion network (AMFNet), which effectively integrates bi-temporal image features and diverse semantics at both the encoding and decoding stages. AMFNet utilizes a unique attention-guided mechanism to dynamically adjust feature fusion, enhancing adaptability and accuracy in change detection tasks. Our method intelligently incorporates temporal information into the deep learning model, considering the temporal dependency inherent in these tasks. We decode based on an interactive feature map, which improves the model's understanding of evolving patterns over time. Additionally, we introduce multi-level supervised training to facilitate the learning of fused features across multiple scales. In comparison with different algorithms, our proposed method achieves F1 values of 0.9079, 0.8225, and 0.8809 in the LEVIR-CD, GZ-CD, and SYSU-CD datasets, respectively. Our model outperforms the SOTA model, SAGNet, by 0.69% in terms of F1 and 1.15% in terms of IoU on the LEVIR-CD dataset, by 2.8% in terms of F1 and 1.79% in terms of IoU on the GZ-CD dataset, and by 0.54% in terms of F1 and 0.38% in terms of IoU on the SYSU-CD dataset. The method proposed in this study can be applied to various complex scenarios, establishing a change detection method with strong model generalization capabilities.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] Multi-scale Adaptive Feature Fusion Network for Semantic Segmentation in Remote Sensing Images
    Shang, Ronghua
    Zhang, Jiyu
    Jiao, Licheng
    Li, Yangyang
    Marturi, Naresh
    Stolkin, Rustam
    REMOTE SENSING, 2020, 12 (05)
  • [22] Change detection using multi-scale convolutional feature maps of bi-temporal satellite high-resolution images
    Alshehhi, Rasha
    Marpu, Prashanth R.
    EUROPEAN JOURNAL OF REMOTE SENSING, 2023, 56 (01)
  • [23] Semantic Segmentation of Remote Sensing Images Based on Dual Attention and Multi-scale Feature Fusion
    Weng, Mengqian
    Hu, Zhibo
    Xie, Xiaopeng
    Li, Yunhong
    Hu, Lei
    TWELFTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2020), 2021, 11720
  • [24] Remote Sensing Image Change Detection on Multi-Scale MRF Fusion
    Wang, W. X.
    Yu, Tianchao
    REMOTE SENSING AND MODELING OF ECOSYSTEMS FOR SUSTAINABILITY VIII, 2011, 8156
  • [25] A Temporal-Reliable Method for Change Detection in High-Resolution Bi-Temporal Remote Sensing Images
    Pan, Fei
    Wu, Zebin
    Jia, Xiuping
    Liu, Qian
    Xu, Yang
    Wei, Zhihui
    REMOTE SENSING, 2022, 14 (13)
  • [26] ADMNet: Attention-Guided Densely Multi-Scale Network for Lightweight Salient Object Detection
    Zhou, Xiaofei
    Shen, Kunye
    Liu, Zhi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 10828 - 10841
  • [27] A Multi-Scale Progressive Collaborative Attention Network for Remote Sensing Fusion Classification
    Ma, Wenping
    Li, Yating
    Zhu, Hao
    Ma, Haoxiang
    Jiao, Licheng
    Shen, Jianchao
    Hou, Biao
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (08) : 3897 - 3911
  • [28] Attention-Guided Deep Neural Network With Multi-Scale Feature Fusion for Liver Vessel Segmentation
    Yan, Qingsen
    Wang, Bo
    Zhang, Wei
    Luo, Chuan
    Xu, Wei
    Xu, Zhengqing
    Zhang, Yanning
    Shi, Qinfeng
    Zhang, Liang
    You, Zheng
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2021, 25 (07) : 2629 - 2642
  • [29] Transformer-based multi-scale feature fusion network for remote sensing change detection
    Liang, Shike
    Hua, Zhen
    Li, Jinjiang
    JOURNAL OF APPLIED REMOTE SENSING, 2022, 16 (04)
  • [30] AMCA: Attention-Guided Multiscale Context Aggregation Network for Remote Sensing Image Change Detection
    Xu, Xintao
    Yang, Zhe
    Li, Jinjiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61