A CBAM Based Multiscale Transformer Fusion Approach for Remote Sensing Image Change Detection

被引:87
作者
Wang, Wei [1 ]
Tan, Xinai [1 ]
Zhang, Peng [2 ]
Wang, Xin [1 ]
机构
[1] Changsha Univ Sci & Technol, Sch Comp & Commun Engn, Changsha 410114, Peoples R China
[2] Sun Yat Sen Univ, Sch Elect & Commun Engn, Shenzhen Campus, Shenzhen 518107, Peoples R China
关键词
Transformers; Feature extraction; Remote sensing; Context modeling; Data mining; Semantics; Decoding; Change detection; convolutional block attention module (CBAM); multiscale; remote sensing; transformer; NETWORK;
D O I
10.1109/JSTARS.2022.3198517
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Change detection methods play an indispensable role in remote sensing. Some change detection methods have obtained a fairly good performance by introducing attention mechanism on the basis of the convolutional neural network (CNN), but identifying intricate changes remains difficult. In response to these problems, this article proposes a new model for detecting changes in remote sensing, namely, MTCNet, which combines the advantages of multiscale transformer with the convolutional block attention module (CBAM) to improve the detection quality of different remote sensing images. On the basis of traditional convolutions, the transformer module is introduced to extract bitemporal image features by modeling contextual information. Based on the transformer module, a multiscale module is designed to form a multiscale transformer, which can obtain features at different scales in bitemporal images, thereby identifying the changes we are interested in. Based on the multiscale transformer module, the CBAM is introduced. The CBAM is split into a spatial attention module and a channel attention module, which are applied to the front and back ends of the multiscale transformer, respectively. Spatial information and channel information of feature maps are modeled separately. In this article, the validity and efficiency of the method are verified by a large number of experiments on the LEVIR-CD dataset and the WHU-CD dataset.
引用
收藏
页码:6817 / 6825
页数:9
相关论文
共 41 条
  • [1] Bandara WGC, 2022, Arxiv, DOI arXiv:2201.01293
  • [2] PPCNET: A Combined Patch-Level and Pixel-Level End-to-End Deep Network for High-Resolution Remote Sensing Image Change Detection
    Bao, Tengfei
    Fu, Chenqin
    Fang, Tao
    Huo, Hong
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (10) : 1797 - 1801
  • [3] Carion Nicolas, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12346), P213, DOI 10.1007/978-3-030-58452-8_13
  • [4] Adversarial Instance Augmentation for Building Change Detection in Remote Sensing Images
    Chen, Hao
    Li, Wenyuan
    Shi, Zhenwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [5] Remote Sensing Image Change Detection With Transformers
    Chen, Hao
    Qi, Zipeng
    Shi, Zhenwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [6] A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection
    Chen, Hao
    Shi, Zhenwei
    [J]. REMOTE SENSING, 2020, 12 (10)
  • [7] DASNet: Dual Attentive Fully Convolutional Siamese Networks for Change Detection in High-Resolution Satellite Images
    Chen, Jie
    Yuan, Ziyang
    Peng, Jian
    Chen, Li
    Huang, Haozhe
    Zhu, Jiawei
    Liu, Yu
    Li, Haifeng
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 1194 - 1206
  • [8] Daudt RC, 2018, IEEE IMAGE PROC, P4063, DOI 10.1109/ICIP.2018.8451652
  • [9] Change Detection of Deforestation in the Brazilian Amazon Using Landsat Data and Convolutional Neural Networks
    de Bem, Pablo Pozzobon
    de Carvalho Junior, Osmar Abilio
    Guimaraes, Renato Fontes
    Trancoso Gomes, Roberto Arnaldo
    [J]. REMOTE SENSING, 2020, 12 (06)
  • [10] Looking for Change? Roll the Dice and Demand Attention
    Diakogiannis, Foivos I.
    Waldner, Francois
    Caccetta, Peter
    [J]. REMOTE SENSING, 2021, 13 (18)