TChange: A Hybrid Transformer-CNN Change Detection Network

被引:15
作者
Deng, Yupeng [1 ,2 ,3 ]
Meng, Yu [1 ]
Chen, Jingbo [1 ]
Yue, Anzhi [1 ]
Liu, Diyou [1 ]
Chen, Jing [1 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Univ Chinese Acad Sci, Elect Elect & Commun Engn, Beijing 100190, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
deep learning; change detection; convolutional neural network; multihead attention; transformer; IMAGES;
D O I
10.3390/rs15051219
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Change detection is employed to identify regions of change between two different time phases. Presently, the CNN-based change detection algorithm is the mainstream direction of change detection. However, there are two challenges in current change detection methods: (1) the intrascale problem: CNN-based change detection algorithms, due to the local receptive field limitation, can only fuse pairwise characteristics in a local range within a single scale, causing incomplete detection of large-scale targets. (2) The interscale problem: Current algorithms generally fuse layer by layer for interscale communication, with one-way flow of information and long propagation links, which are prone to information loss, making it difficult to take into account both large targets and small targets. To address the above issues, a hybrid transformer-CNN change detection network (TChange) for very-high-spatial-resolution (VHR) remote sensing images is proposed. (1) Change multihead self-attention (Change MSA) is built for global intrascale information exchange of spatial features and channel characteristics. (2) An interscale transformer module (ISTM) is proposed to perform direct interscale information exchange. To address the problem that the transformer tends to lose high-frequency features, the use of deep edge supervision is proposed to replace the commonly utilized depth supervision. TChange achieves state-of-the-art scores on the WUH-CD and LEVIR-CD open-source datasets. Furthermore, to validate the effectiveness of Change MSA and the ISTM proposed by TChange, we construct a change detection dataset, TZ-CD, that covers an area of 900 km2 and contains numerous large targets and weak change targets.
引用
收藏
页数:20
相关论文
共 52 条
  • [51] CLNet: Cross-layer convolutional neural network for change detection in optical remote sensing imagery
    Zheng, Zhi
    Wan, Yi
    Zhang, Yongjun
    Xiang, Sizhe
    Peng, Daifeng
    Zhang, Bin
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 175 : 247 - 267
  • [52] Zhu X., 2020, ARXIV