FCCDN: Feature constraint network for VHR image change detection

被引:162
作者
Chen, Pan [1 ,3 ]
Zhang, Bing [1 ,3 ]
Hong, Danfeng [1 ]
Chen, Zhengchao [2 ]
Yang, Xuan [1 ,3 ]
Li, Baipeng [2 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Beijing 100094, Peoples R China
[2] Chinese Acad Sci, Aerosp Informat Res Inst, Airborne Remote Sensing Ctr, Beijing 100094, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
Change detection; Deep learning; Feature constraint; CONVOLUTIONAL NEURAL-NETWORK; FOREST;
D O I
10.1016/j.isprsjprs.2022.02.021
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
Change detection is of great significance to Earth observations. Recently, with the emergence of deep learning (DL), the power and feasibility of deep convolutional neural network (CNN)-based methods have been shown in the field of change detection. However, there is still a lack of effective supervision for change feature learning. In this work, a feature constraint change detection network (FCCDN) is proposed. We constrain features both in bitemporal feature extraction and feature fusion. More specifically, we propose a dual encoder-decoder network backbone for the change detection task. At the center of the backbone, we design a nonlocal feature pyramid network to extract and fuse multiscale features. To fuse bitemporal features in a robust way, we build a dense connection-based feature fusion module. Moreover, a self-supervised learning-based strategy is proposed to constrain feature learning. Based on FCCDN, we achieve state-of-the-art performance on three change detection datasets (LEVIR-CD, WHU, and SECOND). The experimental results show that FCCDN outperforms all benchmark methods. Moreover, for the first time, the acquisition of accurate bitemporal semantic segmentation results is achieved without using semantic segmentation labels. This is vital for the application of change detection because it saves the cost of labeling. The code of this work can be found on https://github.com/chenpan0615/ FCCDN_pytorch.
引用
收藏
页码:101 / 119
页数:19
相关论文
共 71 条
[31]   Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey [J].
Jing, Longlong ;
Tian, Yingli .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (11) :4037-4058
[32]  
Kingma D. P., 2015, ACS SYM SER
[33]   Deep learning [J].
LeCun, Yann ;
Bengio, Yoshua ;
Hinton, Geoffrey .
NATURE, 2015, 521 (7553) :436-444
[34]  
Li H., 2018, BRIT MACH VIS C
[35]   Feature Pyramid Networks for Object Detection [J].
Lin, Tsung-Yi ;
Dollar, Piotr ;
Girshick, Ross ;
He, Kaiming ;
Hariharan, Bharath ;
Belongie, Serge .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :936-944
[36]   Convolutional Neural Network-Based Transfer Learning for Optical Aerial Images Change Detection [J].
Liu, Junfu ;
Chen, Keming ;
Xu, Guangluan ;
Sun, Xian ;
Yan, Menglong ;
Diao, Wenhui ;
Han, Hongzhe .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (01) :127-131
[37]   Deep Depthwise Separable Convolutional Network for Change Detection in Optical Aerial Images [J].
Liu, Ruochen ;
Jiang, Dawei ;
Zhang, Langlang ;
Zhang, Zetong .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :1109-1118
[38]   Sequential Spectral Change Vector Analysis for Iteratively Discovering and Detecting Multiple Changes in Hyperspectral Images [J].
Liu, Sicong ;
Bruzzone, Lorenzo ;
Bovolo, Francesca ;
Zanetti, Massimo ;
Du, Peijun .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (08) :4363-4378
[39]  
Long J, 2015, PROC CVPR IEEE, P3431, DOI 10.1109/CVPR.2015.7298965
[40]  
Mahmoodzadeh H, 2007, INT J ENVIRON RES, V1, P35