FCCDN: Feature constraint network for VHR image change detection

被引:162
作者
Chen, Pan [1 ,3 ]
Zhang, Bing [1 ,3 ]
Hong, Danfeng [1 ]
Chen, Zhengchao [2 ]
Yang, Xuan [1 ,3 ]
Li, Baipeng [2 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Beijing 100094, Peoples R China
[2] Chinese Acad Sci, Aerosp Informat Res Inst, Airborne Remote Sensing Ctr, Beijing 100094, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
Change detection; Deep learning; Feature constraint; CONVOLUTIONAL NEURAL-NETWORK; FOREST;
D O I
10.1016/j.isprsjprs.2022.02.021
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
Change detection is of great significance to Earth observations. Recently, with the emergence of deep learning (DL), the power and feasibility of deep convolutional neural network (CNN)-based methods have been shown in the field of change detection. However, there is still a lack of effective supervision for change feature learning. In this work, a feature constraint change detection network (FCCDN) is proposed. We constrain features both in bitemporal feature extraction and feature fusion. More specifically, we propose a dual encoder-decoder network backbone for the change detection task. At the center of the backbone, we design a nonlocal feature pyramid network to extract and fuse multiscale features. To fuse bitemporal features in a robust way, we build a dense connection-based feature fusion module. Moreover, a self-supervised learning-based strategy is proposed to constrain feature learning. Based on FCCDN, we achieve state-of-the-art performance on three change detection datasets (LEVIR-CD, WHU, and SECOND). The experimental results show that FCCDN outperforms all benchmark methods. Moreover, for the first time, the acquisition of accurate bitemporal semantic segmentation results is achieved without using semantic segmentation labels. This is vital for the application of change detection because it saves the cost of labeling. The code of this work can be found on https://github.com/chenpan0615/ FCCDN_pytorch.
引用
收藏
页码:101 / 119
页数:19
相关论文
共 71 条
[61]  
Zagoruyko S, 2015, PROC CVPR IEEE, P4353, DOI 10.1109/CVPR.2015.7299064
[62]   Remotely sensed big data: evolution in model development for information extraction [point of view] [J].
Zhang, Bing ;
Chen, Zhengchao ;
Peng, Dailiang ;
Benediktsson, Jon Atli ;
Liu, Bo ;
Zou, Lei ;
Li, Jun ;
Plaza, Antonio .
PROCEEDINGS OF THE IEEE, 2019, 107 (12) :2294-2301
[63]   A deeply supervised image fusion network for change detection in high resolution bi-temporal remote sensing images [J].
Zhang, Chenxiao ;
Yue, Peng ;
Tapete, Deodato ;
Jiang, Liangcun ;
Shangguan, Boyi ;
Huang, Li ;
Liu, Guangchao .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 166 :183-200
[64]   Object-level change detection with a dual correlation attention-guided detector [J].
Zhang, Lin ;
Hu, Xiangyun ;
Zhang, Mi ;
Shu, Zhen ;
Zhou, Hao .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 177 :147-160
[65]   Colorful Image Colorization [J].
Zhang, Richard ;
Isola, Phillip ;
Efros, Alexei A. .
COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 :649-666
[66]   HDFNet: Hierarchical Dynamic Fusion Network for Change Detection in Optical Aerial Images [J].
Zhang, Yi ;
Fu, Lei ;
Li, Ying ;
Zhang, Yanning .
REMOTE SENSING, 2021, 13 (08)
[67]   Pyramid Scene Parsing Network [J].
Zhao, Hengshuang ;
Shi, Jianping ;
Qi, Xiaojuan ;
Wang, Xiaogang ;
Jia, Jiaya .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6230-6239
[68]   CLNet: Cross-layer convolutional neural network for change detection in optical remote sensing imagery [J].
Zheng, Zhi ;
Wan, Yi ;
Zhang, Yongjun ;
Xiang, Sizhe ;
Peng, Daifeng ;
Zhang, Bin .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 175 :247-267
[69]   D-LinkNet: LinkNet with Pretrained Encoder and Dilated Convolution for High Resolution Satellite Imagery Road Extraction [J].
Zhou, Lichen ;
Zhang, Chuang ;
Wu, Ming .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :192-196
[70]   UNet plus plus : A Nested U-Net Architecture for Medical Image Segmentation [J].
Zhou, Zongwei ;
Siddiquee, Md Mahfuzur Rahman ;
Tajbakhsh, Nima ;
Liang, Jianming .
DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, DLMIA 2018, 2018, 11045 :3-11