MIFNet: Multi-Scale Interaction Fusion Network for Remote Sensing Image Change Detection

被引:0
作者
Xie, Weiying [1 ]
Shao, Wenjie [1 ]
Li, Daixun [1 ]
Li, Yunsong [1 ]
Fang, Leyuan [2 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Networks, Xidian 710071, Peoples R China
[2] Hunan Univ, Coll Elect & Informat Engn, Changsha 410082, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Remote sensing; Data mining; Semantics; Attention mechanisms; Transformers; Cross layer design; Circuits and systems; Accuracy; Fuses; Change detection; remote sensing; attention; convolutional neural networks; multi-scale;
D O I
10.1109/TCSVT.2024.3494820
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Change Detection (CD) is a crucial and challenging task in remote sensing observations. Despite the remarkable progress driven by deep learning in remote sensing change detection, several challenges remain regarding global information representation and efficient interaction. The traditional Siamese network structure, which extracts features from bitemporal images using a weight-sharing network and generates a change map, but often neglects phase interaction information between images. Additionally, multi-scale feature fusion methods frequently use FPN-like structures, leading to lossy cross-layer information transmission and hindering the effective utilization of features. To address these issues, we propose a multi-scale interaction fusion network (MIFNet) that fuses bitemporal features at an early stage, using deep supervision techniques to guide early fusion features in obtaining abundant semantic representation of changes, also we construct a dual complementary attention module (DCA) to capture temporal information. Furthermore, we introduce a collection-allocation fusion mechanism, which is different from previous layer-by-layer fusion methods since it collects global information and embeds features at different levels to achieve effective cross-layer information transmission and promote global semantic feature representation. Extensive experiments demonstrate that our method achieves competitive results on the LEVIR-CD+ dataset, outperforming other advanced methods on both the LEVIR-CD and SYSU-CD datasets, with F1 improved by 0.96% and 0.61%, respectively, compared to the most advanced models.
引用
收藏
页码:2725 / 2739
页数:15
相关论文
共 65 条
  • [21] PGA-SiamNet: Pyramid Feature-Based Attention-Guided Siamese Network for Remote Sensing Orthoimagery Building Change Detection
    Jiang, Huiwei
    Hu, Xiangyun
    Li, Kun
    Zhang, Jinming
    Gong, Jinqi
    Zhang, Mi
    [J]. REMOTE SENSING, 2020, 12 (03)
  • [22] Global, Landsat-based forest-cover change from 1990 to 2000
    Kim, Do-Hyung
    Sexton, Joseph O.
    Noojipady, Praveen
    Huang, Chengquan
    Anand, Anupam
    Channan, Saurabh
    Feng, Min
    Townshend, John R.
    [J]. REMOTE SENSING OF ENVIRONMENT, 2014, 155 : 178 - 193
  • [23] Local Similarity Siamese Network for Urban Land Change Detection on Remote Sensing Images
    Lee, Haeyun
    Lee, Kyungsu
    Kim, Jun Hee
    Na, Younghwan
    Park, Juhum
    Choi, Jihwan P.
    Hwang, Jae Youn
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 4139 - 4149
  • [24] Ultralightweight Spatial-Spectral Feature Cooperation Network for Change Detection in Remote Sensing Images
    Lei, Tao
    Geng, Xinzhe
    Ning, Hailong
    Lv, Zhiyong
    Gong, Maoguo
    Jin, Yaochu
    Nandis, Asoke K. K.
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [25] Difference Enhancement and SpatialSpectral Nonlocal Network for Change Detection in VHR Remote Sensing Images
    Lei, Tao
    Wang, Jie
    Ning, Hailong
    Wang, Xingwu
    Xue, Dinghua
    Wang, Qi
    Nandi, Asoke K.
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [26] Landslide Inventory Mapping From Bitemporal Images Using Deep Convolutional Neural Networks
    Lei, Tao
    Zhang, Yuxiao
    Lv, Zhiyong
    Li, Shuying
    Liu, Shigang
    Nandi, Asoke K.
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (06) : 982 - 986
  • [27] FedDiff: Diffusion Model Driven Federated Learning for Multi-Modal and Multi-Clients
    Li, Daixun
    Xie, Weiying
    Wang, Zixuan
    Lu, Yibing
    Li, Yunsong
    Fang, Leyuan
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (10) : 10353 - 10367
  • [28] Detecting Building Changes Using Multimodal Siamese Multitask Networks From Very-High-Resolution Satellite Images
    Li, Mengmeng
    Liu, Xuanguang
    Wang, Xiaoqin
    Xiao, Pengfeng
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [29] TransUNetCD: A Hybrid Transformer Network for Change Detection in Optical Remote-Sensing Images
    Li, Qingyang
    Zhong, Ruofei
    Du, Xin
    Du, Yu
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [30] Selective Kernel Networks
    Li, Xiang
    Wang, Wenhai
    Hu, Xiaolin
    Yang, Jian
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 510 - 519