AMFNet: Attention-Guided Multi-Scale Fusion Network for Bi-Temporal Change Detection in Remote Sensing Images

被引:8
|
作者
Zhan, Zisen [1 ]
Ren, Hongjin [1 ]
Xia, Min [1 ]
Lin, Haifeng [2 ]
Wang, Xiaoya [1 ,3 ]
Li, Xin [2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Collaborat Innovat Ctr Atmospher Environm & Equipm, Nanjing 210044, Peoples R China
[2] Nanjing Forestry Univ, Coll Informat Sci & Technol, Nanjing 210000, Peoples R China
[3] Univ Reading, Dept Comp Sci, Reading RG6 6DH, England
关键词
change detection; remote sensing image; deep learning; multi-scale supervised; USE/LAND-COVER CHANGE; URBAN EXPANSION; OPTICAL-IMAGES; SAR;
D O I
10.3390/rs16101765
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Change detection is crucial for evaluating land use, land cover changes, and sustainable development, constituting a significant component of Earth observation tasks. The difficulty in extracting features from high-resolution images, coupled with the complexity of image content, poses challenges for traditional change detection algorithms in terms of accuracy and applicability. The recent emergence of deep learning methods has led to substantial progress in the field of change detection. However, existing frameworks often involve the simplistic integration of bi-temporal features in specific areas, lacking the fusion of temporal information and semantic details in the images. In this paper, we propose an attention-guided multi-scale fusion network (AMFNet), which effectively integrates bi-temporal image features and diverse semantics at both the encoding and decoding stages. AMFNet utilizes a unique attention-guided mechanism to dynamically adjust feature fusion, enhancing adaptability and accuracy in change detection tasks. Our method intelligently incorporates temporal information into the deep learning model, considering the temporal dependency inherent in these tasks. We decode based on an interactive feature map, which improves the model's understanding of evolving patterns over time. Additionally, we introduce multi-level supervised training to facilitate the learning of fused features across multiple scales. In comparison with different algorithms, our proposed method achieves F1 values of 0.9079, 0.8225, and 0.8809 in the LEVIR-CD, GZ-CD, and SYSU-CD datasets, respectively. Our model outperforms the SOTA model, SAGNet, by 0.69% in terms of F1 and 1.15% in terms of IoU on the LEVIR-CD dataset, by 2.8% in terms of F1 and 1.79% in terms of IoU on the GZ-CD dataset, and by 0.54% in terms of F1 and 0.38% in terms of IoU on the SYSU-CD dataset. The method proposed in this study can be applied to various complex scenarios, establishing a change detection method with strong model generalization capabilities.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Attention-Guided Siamese Fusion Network for Change Detection of Remote Sensing Images
    Chen, Puhua
    Guo, Lei
    Zhang, Xiangrong
    Qin, Kai
    Ma, Wentao
    Jiao, Licheng
    REMOTE SENSING, 2021, 13 (22)
  • [2] Supervised Multi-Scale Attention-Guided Ship Detection in Optical Remote Sensing Images
    Hu, Jianming
    Zhi, Xiyang
    Jiang, Shikai
    Tang, Hao
    Zhang, Wei
    Bruzzone, Lorenzo
    IEEE Transactions on Geoscience and Remote Sensing, 2022, 60
  • [3] Supervised Multi-Scale Attention-Guided Ship Detection in Optical Remote Sensing Images
    Hu, Jianming
    Zhi, Xiyang
    Jiang, Shikai
    Tang, Hao
    Zhang, Wei
    Bruzzone, Lorenzo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] A deeply supervised image fusion network for change detection in high resolution bi-temporal remote sensing images
    Zhang, Chenxiao
    Yue, Peng
    Tapete, Deodato
    Jiang, Liangcun
    Shangguan, Boyi
    Huang, Li
    Liu, Guangchao
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 166 : 183 - 200
  • [5] A Multi-Feature Fusion and Attention Network for Multi-Scale Object Detection in Remote Sensing Images
    Cheng, Yong
    Wang, Wei
    Zhang, Wenjie
    Yang, Ling
    Wang, Jun
    Ni, Huan
    Guan, Tingzhao
    He, Jiaxin
    Gu, Yakang
    Tran, Ngoc Nguyen
    REMOTE SENSING, 2023, 15 (08)
  • [6] Dual Part Siamese Attention Convolution Network for Change detection in Bi-temporal High Resolution Remote Sensing Images
    Li Zongpu
    Bao Tengfei
    Xiao Zhiyun
    2024 16TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND COMPUTING, ICMLC 2024, 2024, : 298 - 303
  • [7] Edge-guided multi-scale foreground attention network for change detection in high resolution remote sensing images
    Lin, Junjie
    Wang, Guojie
    Peng, Daifeng
    Guan, Haiyan
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 133
  • [8] Multi-scale attention fusion network for semantic segmentation of remote sensing images
    Wen, Zhiqiang
    Huang, Hongxu
    Liu, Shuai
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (24) : 7909 - 7926
  • [9] Multi-scale Cross Dual Attention Network for Building Change Detection in Remote Sensing Images
    Zhang J.
    Yan Z.
    Ma S.
    Journal of Geo-Information Science, 2023, 25 (12) : 2487 - 2500
  • [10] Y-Net: A Multiclass Change Detection Network for Bi-temporal Remote Sensing Images
    Wang, Decheng
    Zhao, Feng
    Wang, Chao
    Wang, Haoyue
    Zheng, Fengjie
    Chen, Xiangning
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (02) : 565 - 592