A Multiscale Cascaded Cross-Attention Hierarchical Network for Change Detection on Bitemporal Remote Sensing Images

被引:3
作者
Zhang, Xiaofeng [1 ]
Wang, Liejun [1 ]
Cheng, Shuli [1 ]
机构
[1] Xinjiang Univ, Sch Comp Sci & Technol, Urumqi 830046, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
关键词
Change detection; convolutional neural network (CNN); multiscale cascaded cross-attention (MSCCA); remote sensing (RS); skip connection;
D O I
10.1109/TGRS.2024.3361847
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Remote sensing image change detection (RSCD) is an important task in remote sensing image interpretation. Some recent RSCD works focus on the extraction and interaction of global and local information; however, the current work underuses hierarchical features and may introduce noise from shallow encoders. In this article, we propose a multiscale cascaded cross-attention hierarchical network (MSCCA-Net). This network uses a large kernel convolution formed by stacking small kernel convolutions combined with an efficient transformer as the backbone network to achieve local and global feature extraction and fusion. We proposed for the first time the idea of bottom-up level-by-level fusion of hierarchical features, based on which we designed the multiscale cascade cross-attention (MSCCA) cross-fusion hierarchical features level by level from the bottom upward, realizing the redistribution of spatial and semantic information, and thus enhancing the gainful effect of the skip connection mechanism in the field of RSCD. Our experiments on three public datasets show that MSCCA is able to efficiently perform the reorganization of hierarchical features, thus avoiding misdetection and omission of small targets. Meanwhile, MSCCA-Net has more excellent comprehensive performance compared with other state-of-the-art methods.
引用
收藏
页码:1 / 16
页数:16
相关论文
共 57 条
  • [1] Street-view change detection with deconvolutional networks
    Alcantarilla, Pablo F.
    Stent, Simon
    Ros, German
    Arroyo, Roberto
    Gherardi, Riccardo
    [J]. AUTONOMOUS ROBOTS, 2018, 42 (07) : 1301 - 1322
  • [2] An Image Change Detection Algorithm Based on Multi-Feature Self-Attention Fusion Mechanism UNet Network
    Alimjan, Gulnaz
    Jiaermuhamaiti, Yiliyaer
    Jumahong, Huxidan
    Zhu, Shuangling
    Nurmamat, Pazilat
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2021, 35 (14)
  • [3] Azad R, 2023, Arxiv, DOI [arXiv:2301.10847, DOI 10.48550/ARXIV.2301.10847]
  • [4] Bandara WGC, 2022, Arxiv, DOI arXiv:2201.01293
  • [5] Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and k-Means Clustering
    Celik, Turgay
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2009, 6 (04) : 772 - 776
  • [6] Remote Sensing Image Change Detection With Transformers
    Chen, Hao
    Qi, Zipeng
    Shi, Zhenwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [7] A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection
    Chen, Hao
    Shi, Zhenwei
    [J]. REMOTE SENSING, 2020, 12 (10)
  • [8] Xception: Deep Learning with Depthwise Separable Convolutions
    Chollet, Francois
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1800 - 1807
  • [9] Daudt RC, 2018, IEEE IMAGE PROC, P4063, DOI 10.1109/ICIP.2018.8451652
  • [10] Davis J., 2006, P 23 INT C MACH LEAR, P233, DOI [DOI 10.1145/1143844.1143874, 10.1145/1143844.1143874]