DCFF-Net: A Densely Connected Feature Fusion Network for Change Detection in High-Resolution Remote Sensing Images

被引:23
作者
Pan, Fei [1 ]
Wu, Zebin [1 ]
Liu, Qian [1 ]
Xu, Yang [1 ]
Wei, Zhihui [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Feature extraction; Remote sensing; Semantics; Image resolution; Image segmentation; Network architecture; Data mining; Change detection (CD); deep learning; feature fusion; remote sensing images;
D O I
10.1109/JSTARS.2021.3129318
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Change detection is one of the main applications of remote sensing image analysis. Due to the strong capabilities of neural networks in other fields, a growing number of research works of automatic remote sensing change detection focus on deep learning algorithms. The network architectures of change detection are mostly based on the encoder-decoder architecture. Although the encoder-decoder architecture can acquire high-level semantic information for change detection, it still exists some problems in high-resolution remote sensing images, such as the loss of high-resolution location information during the down-sampling process, insufficient high-resolution information during the up-sampling reconstruction process, and small changes are challenging to detect. To address these issues, we propose a densely connected feature fusion network (DCFF-Net) for change detection. First, we extract the multiscale raw image features by two-stream network architecture with the same weights. At the same time, bitemporal images are concatenated as one input with six channels to generate the change map by a difference extraction network based on encoder-decoder architecture. In order to better reconstruct the edge details of the change map and the changes with the small region, an attention mechanism is employed in each up-sampling process to fuse the previously extracted raw image features with difference features. The deep supervision strategy is adopted to alleviate the problem of gradient vanishing. In addition, a novel weighted loss is proposed by combining self-adjusting dice loss and binary cross-entropy loss to alleviate the data imbalance issue. We perform extensive experiments on two public change detection datasets. The visual comparison and quantitative evaluation confirm that our proposed method outperformsother state-of-the-art methods.
引用
收藏
页码:11974 / 11985
页数:12
相关论文
共 46 条
[1]   Street-view change detection with deconvolutional networks [J].
Alcantarilla, Pablo F. ;
Stent, Simon ;
Ros, German ;
Arroyo, Roberto ;
Gherardi, Riccardo .
AUTONOMOUS ROBOTS, 2018, 42 (07) :1301-1322
[2]   Automatic analysis of the difference image for unsupervised change detection [J].
Bruzzone, L ;
Prieto, DF .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2000, 38 (03) :1171-1182
[3]   Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and k-Means Clustering [J].
Celik, Turgay .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2009, 6 (04) :772-776
[4]   Object-based change detection [J].
Chen, Gang ;
Hay, Geoffrey J. ;
Carvalho, Luis M. T. ;
Wulder, Michael A. .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2012, 33 (14) :4434-4457
[5]   A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection [J].
Chen, Hao ;
Shi, Zhenwei .
REMOTE SENSING, 2020, 12 (10)
[6]   Land-use/land-cover change detection using improved change-vector analysis [J].
Chen, J ;
Gong, P ;
He, CY ;
Pu, RL ;
Shi, PJ .
PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2003, 69 (04) :369-379
[7]  
Chen KQ, 2017, INT GEOSCI REMOTE SE, P1672, DOI 10.1109/IGARSS.2017.8127295
[8]  
Daudt RC, 2018, IEEE IMAGE PROC, P4063, DOI 10.1109/ICIP.2018.8451652
[9]   PCA-based land-use change detection and analysis using multitemporal and multisensor satellite data [J].
Deng, J. S. ;
Wang, K. ;
Deng, Y. H. ;
Qi, G. J. .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2008, 29 (16) :4823-4838
[10]   SNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR Images [J].
Fang, Sheng ;
Li, Kaiyu ;
Shao, Jinyuan ;
Li, Zhe .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19