A CBAM Based Multiscale Transformer Fusion Approach for Remote Sensing Image Change Detection

被引:87
作者
Wang, Wei [1 ]
Tan, Xinai [1 ]
Zhang, Peng [2 ]
Wang, Xin [1 ]
机构
[1] Changsha Univ Sci & Technol, Sch Comp & Commun Engn, Changsha 410114, Peoples R China
[2] Sun Yat Sen Univ, Sch Elect & Commun Engn, Shenzhen Campus, Shenzhen 518107, Peoples R China
关键词
Transformers; Feature extraction; Remote sensing; Context modeling; Data mining; Semantics; Decoding; Change detection; convolutional block attention module (CBAM); multiscale; remote sensing; transformer; NETWORK;
D O I
10.1109/JSTARS.2022.3198517
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Change detection methods play an indispensable role in remote sensing. Some change detection methods have obtained a fairly good performance by introducing attention mechanism on the basis of the convolutional neural network (CNN), but identifying intricate changes remains difficult. In response to these problems, this article proposes a new model for detecting changes in remote sensing, namely, MTCNet, which combines the advantages of multiscale transformer with the convolutional block attention module (CBAM) to improve the detection quality of different remote sensing images. On the basis of traditional convolutions, the transformer module is introduced to extract bitemporal image features by modeling contextual information. Based on the transformer module, a multiscale module is designed to form a multiscale transformer, which can obtain features at different scales in bitemporal images, thereby identifying the changes we are interested in. Based on the multiscale transformer module, the CBAM is introduced. The CBAM is split into a spatial attention module and a channel attention module, which are applied to the front and back ends of the multiscale transformer, respectively. Spatial information and channel information of feature maps are modeled separately. In this article, the validity and efficiency of the method are verified by a large number of experiments on the LEVIR-CD dataset and the WHU-CD dataset.
引用
收藏
页码:6817 / 6825
页数:9
相关论文
共 41 条
  • [11] Dong Zhang, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12373), P323, DOI 10.1007/978-3-030-58604-1_20
  • [12] Dosovitskiy A, 2021, Arxiv, DOI [arXiv:2010.11929, DOI 10.48550/ARXIV.2010.11929]
  • [13] Dual Learning-Based Siamese Framework for Change Detection Using Bi-Temporal VHR Optical Remote Sensing Images
    Fang, Bo
    Pan, Li
    Kou, Rong
    [J]. REMOTE SENSING, 2019, 11 (11)
  • [14] SNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR Images
    Fang, Sheng
    Li, Kaiyu
    Shao, Jinyuan
    Li, Zhe
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [15] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [16] From W-Net to CDGAN: Bitemporal Change Detection via Deep Learning Techniques
    Hou, Bin
    Liu, Qingjie
    Wang, Heng
    Wang, Yunhong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (03): : 1790 - 1802
  • [17] PGA-SiamNet: Pyramid Feature-Based Attention-Guided Siamese Network for Remote Sensing Orthoimagery Building Change Detection
    Jiang, Huiwei
    Hu, Xiangyun
    Li, Kun
    Zhang, Jinming
    Gong, Jinqi
    Zhang, Mi
    [J]. REMOTE SENSING, 2020, 12 (03)
  • [18] A comprehensive change detection method for updating the National Land Cover Database to circa 2011
    Jin, Suming
    Yang, Limin
    Danielson, Patrick
    Homer, Collin
    Fry, Joyce
    Xian, George
    [J]. REMOTE SENSING OF ENVIRONMENT, 2013, 132 : 159 - 175
  • [19] Lebedev M. A., 2018, P INT ARCH PHOTOGRAM, VXLII- 2, P565, DOI DOI 10.5194/ISPRS-ARCHIVES-XLII-2-565-2018
  • [20] Building Change Detection for Remote Sensing Images Using a Dual-Task Constrained Deep Siamese Convolutional Network Model
    Liu, Yi
    Pang, Chao
    Zhan, Zongqian
    Zhang, Xiaomeng
    Yang, Xue
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (05) : 811 - 815