FCCDN: Feature constraint network for VHR image change detection

被引:125
作者
Chen, Pan [1 ,3 ]
Zhang, Bing [1 ,3 ]
Hong, Danfeng [1 ]
Chen, Zhengchao [2 ]
Yang, Xuan [1 ,3 ]
Li, Baipeng [2 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Beijing 100094, Peoples R China
[2] Chinese Acad Sci, Aerosp Informat Res Inst, Airborne Remote Sensing Ctr, Beijing 100094, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
Change detection; Deep learning; Feature constraint; CONVOLUTIONAL NEURAL-NETWORK; FOREST;
D O I
10.1016/j.isprsjprs.2022.02.021
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
Change detection is of great significance to Earth observations. Recently, with the emergence of deep learning (DL), the power and feasibility of deep convolutional neural network (CNN)-based methods have been shown in the field of change detection. However, there is still a lack of effective supervision for change feature learning. In this work, a feature constraint change detection network (FCCDN) is proposed. We constrain features both in bitemporal feature extraction and feature fusion. More specifically, we propose a dual encoder-decoder network backbone for the change detection task. At the center of the backbone, we design a nonlocal feature pyramid network to extract and fuse multiscale features. To fuse bitemporal features in a robust way, we build a dense connection-based feature fusion module. Moreover, a self-supervised learning-based strategy is proposed to constrain feature learning. Based on FCCDN, we achieve state-of-the-art performance on three change detection datasets (LEVIR-CD, WHU, and SECOND). The experimental results show that FCCDN outperforms all benchmark methods. Moreover, for the first time, the acquisition of accurate bitemporal semantic segmentation results is achieved without using semantic segmentation labels. This is vital for the application of change detection because it saves the cost of labeling. The code of this work can be found on https://github.com/chenpan0615/ FCCDN_pytorch.
引用
收藏
页码:101 / 119
页数:19
相关论文
共 71 条
  • [61] Zagoruyko S, 2015, PROC CVPR IEEE, P4353, DOI 10.1109/CVPR.2015.7299064
  • [62] Remotely sensed big data: evolution in model development for information extraction [point of view]
    Zhang, Bing
    Chen, Zhengchao
    Peng, Dailiang
    Benediktsson, Jon Atli
    Liu, Bo
    Zou, Lei
    Li, Jun
    Plaza, Antonio
    [J]. PROCEEDINGS OF THE IEEE, 2019, 107 (12) : 2294 - 2301
  • [63] A deeply supervised image fusion network for change detection in high resolution bi-temporal remote sensing images
    Zhang, Chenxiao
    Yue, Peng
    Tapete, Deodato
    Jiang, Liangcun
    Shangguan, Boyi
    Huang, Li
    Liu, Guangchao
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 166 : 183 - 200
  • [64] Object-level change detection with a dual correlation attention-guided detector
    Zhang, Lin
    Hu, Xiangyun
    Zhang, Mi
    Shu, Zhen
    Zhou, Hao
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 177 : 147 - 160
  • [65] Colorful Image Colorization
    Zhang, Richard
    Isola, Phillip
    Efros, Alexei A.
    [J]. COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 : 649 - 666
  • [66] HDFNet: Hierarchical Dynamic Fusion Network for Change Detection in Optical Aerial Images
    Zhang, Yi
    Fu, Lei
    Li, Ying
    Zhang, Yanning
    [J]. REMOTE SENSING, 2021, 13 (08)
  • [67] Pyramid Scene Parsing Network
    Zhao, Hengshuang
    Shi, Jianping
    Qi, Xiaojuan
    Wang, Xiaogang
    Jia, Jiaya
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 6230 - 6239
  • [68] CLNet: Cross-layer convolutional neural network for change detection in optical remote sensing imagery
    Zheng, Zhi
    Wan, Yi
    Zhang, Yongjun
    Xiang, Sizhe
    Peng, Daifeng
    Zhang, Bin
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 175 : 247 - 267
  • [69] D-LinkNet: LinkNet with Pretrained Encoder and Dilated Convolution for High Resolution Satellite Imagery Road Extraction
    Zhou, Lichen
    Zhang, Chuang
    Wu, Ming
    [J]. PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 192 - 196
  • [70] UNet plus plus : A Nested U-Net Architecture for Medical Image Segmentation
    Zhou, Zongwei
    Siddiquee, Md Mahfuzur Rahman
    Tajbakhsh, Nima
    Liang, Jianming
    [J]. DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, DLMIA 2018, 2018, 11045 : 3 - 11