FCCDN: Feature constraint network for VHR image change detection

被引:125
作者
Chen, Pan [1 ,3 ]
Zhang, Bing [1 ,3 ]
Hong, Danfeng [1 ]
Chen, Zhengchao [2 ]
Yang, Xuan [1 ,3 ]
Li, Baipeng [2 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Beijing 100094, Peoples R China
[2] Chinese Acad Sci, Aerosp Informat Res Inst, Airborne Remote Sensing Ctr, Beijing 100094, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
Change detection; Deep learning; Feature constraint; CONVOLUTIONAL NEURAL-NETWORK; FOREST;
D O I
10.1016/j.isprsjprs.2022.02.021
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
Change detection is of great significance to Earth observations. Recently, with the emergence of deep learning (DL), the power and feasibility of deep convolutional neural network (CNN)-based methods have been shown in the field of change detection. However, there is still a lack of effective supervision for change feature learning. In this work, a feature constraint change detection network (FCCDN) is proposed. We constrain features both in bitemporal feature extraction and feature fusion. More specifically, we propose a dual encoder-decoder network backbone for the change detection task. At the center of the backbone, we design a nonlocal feature pyramid network to extract and fuse multiscale features. To fuse bitemporal features in a robust way, we build a dense connection-based feature fusion module. Moreover, a self-supervised learning-based strategy is proposed to constrain feature learning. Based on FCCDN, we achieve state-of-the-art performance on three change detection datasets (LEVIR-CD, WHU, and SECOND). The experimental results show that FCCDN outperforms all benchmark methods. Moreover, for the first time, the acquisition of accurate bitemporal semantic segmentation results is achieved without using semantic segmentation labels. This is vital for the application of change detection because it saves the cost of labeling. The code of this work can be found on https://github.com/chenpan0615/ FCCDN_pytorch.
引用
收藏
页码:101 / 119
页数:19
相关论文
共 71 条
  • [31] Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey
    Jing, Longlong
    Tian, Yingli
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (11) : 4037 - 4058
  • [32] King DB, 2015, ACS SYM SER, V1214, P1
  • [33] Deep learning
    LeCun, Yann
    Bengio, Yoshua
    Hinton, Geoffrey
    [J]. NATURE, 2015, 521 (7553) : 436 - 444
  • [34] Li H., 2018, Pyramid attention network for semantic segmentation. arXiv preprint arXiv:1805.10180, P285
  • [35] Feature Pyramid Networks for Object Detection
    Lin, Tsung-Yi
    Dollar, Piotr
    Girshick, Ross
    He, Kaiming
    Hariharan, Bharath
    Belongie, Serge
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 936 - 944
  • [36] Convolutional Neural Network-Based Transfer Learning for Optical Aerial Images Change Detection
    Liu, Junfu
    Chen, Keming
    Xu, Guangluan
    Sun, Xian
    Yan, Menglong
    Diao, Wenhui
    Han, Hongzhe
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (01) : 127 - 131
  • [37] Deep Depthwise Separable Convolutional Network for Change Detection in Optical Aerial Images
    Liu, Ruochen
    Jiang, Dawei
    Zhang, Langlang
    Zhang, Zetong
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 1109 - 1118
  • [38] Sequential Spectral Change Vector Analysis for Iteratively Discovering and Detecting Multiple Changes in Hyperspectral Images
    Liu, Sicong
    Bruzzone, Lorenzo
    Bovolo, Francesca
    Zanetti, Massimo
    Du, Peijun
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (08): : 4363 - 4378
  • [39] Long J, 2015, PROC CVPR IEEE, P3431, DOI 10.1109/CVPR.2015.7298965
  • [40] Mahmoodzadeh H, 2007, INT J ENVIRON RES, V1, P35