TChange: A Hybrid Transformer-CNN Change Detection Network

被引:15
作者
Deng, Yupeng [1 ,2 ,3 ]
Meng, Yu [1 ]
Chen, Jingbo [1 ]
Yue, Anzhi [1 ]
Liu, Diyou [1 ]
Chen, Jing [1 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Univ Chinese Acad Sci, Elect Elect & Commun Engn, Beijing 100190, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
deep learning; change detection; convolutional neural network; multihead attention; transformer; IMAGES;
D O I
10.3390/rs15051219
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Change detection is employed to identify regions of change between two different time phases. Presently, the CNN-based change detection algorithm is the mainstream direction of change detection. However, there are two challenges in current change detection methods: (1) the intrascale problem: CNN-based change detection algorithms, due to the local receptive field limitation, can only fuse pairwise characteristics in a local range within a single scale, causing incomplete detection of large-scale targets. (2) The interscale problem: Current algorithms generally fuse layer by layer for interscale communication, with one-way flow of information and long propagation links, which are prone to information loss, making it difficult to take into account both large targets and small targets. To address the above issues, a hybrid transformer-CNN change detection network (TChange) for very-high-spatial-resolution (VHR) remote sensing images is proposed. (1) Change multihead self-attention (Change MSA) is built for global intrascale information exchange of spatial features and channel characteristics. (2) An interscale transformer module (ISTM) is proposed to perform direct interscale information exchange. To address the problem that the transformer tends to lose high-frequency features, the use of deep edge supervision is proposed to replace the commonly utilized depth supervision. TChange achieves state-of-the-art scores on the WUH-CD and LEVIR-CD open-source datasets. Furthermore, to validate the effectiveness of Change MSA and the ISTM proposed by TChange, we construct a change detection dataset, TZ-CD, that covers an area of 900 km2 and contains numerous large targets and weak change targets.
引用
收藏
页数:20
相关论文
共 52 条
  • [1] Change detection techniques for remote sensing applications: a survey
    Asokan, Anju
    Anitha, J.
    [J]. EARTH SCIENCE INFORMATICS, 2019, 12 (02) : 143 - 160
  • [2] Chen H N., 2019, DEEP LEARNING APPROA, P1
  • [3] A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection
    Chen, Hao
    Shi, Zhenwei
    [J]. REMOTE SENSING, 2020, 12 (10)
  • [4] Land-use/land-cover change detection using improved change-vector analysis
    Chen, J
    Gong, P
    He, CY
    Pu, RL
    Shi, PJ
    [J]. PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2003, 69 (04) : 369 - 379
  • [5] TEMDnet: A Novel Deep Denoising Network for Transient Electromagnetic Signal With Signal-to-Image Transformation
    Chen, Kecheng
    Pu, Xiaorong
    Ren, Yazhou
    Qiu, Hang
    Lin, Fanqiang
    Zhang, Saimin
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [6] A Region-Based Feature Fusion Network for VHR Image Change Detection
    Chen, Pan
    Li, Cong
    Zhang, Bing
    Chen, Zhengchao
    Yang, Xuan
    Lu, Kaixuan
    Zhuang, Lina
    [J]. REMOTE SENSING, 2022, 14 (21)
  • [7] FCCDN: Feature constraint network for VHR image change detection
    Chen, Pan
    Zhang, Bing
    Hong, Danfeng
    Chen, Zhengchao
    Yang, Xuan
    Li, Baipeng
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 187 : 101 - 119
  • [8] Cheng B., 2022, MASKED ATTENTION MAS, P1290
  • [9] A hierarchical self-attention augmented Laplacian pyramid expanding network for change detection in high-resolution remote sensing images
    Cheng, Hongquan
    Wu, Huayi
    Zheng, Jie
    Qi, Kunlun
    Liu, Wenxuan
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 182 : 52 - 66
  • [10] Coppin PR., 1996, Remote Sens Rev, V13, P207, DOI DOI 10.1080/02757259609532305