Local Descriptor Learning for Change Detection in Synthetic Aperture Radar Images via Convolutional Neural Networks

被引:41
作者
Dong, Huihui [1 ]
Ma, Wenping [1 ]
Wu, Yue [2 ]
Gong, Maoguo [3 ]
Jiao, Licheng [1 ]
机构
[1] Xidian Univ, Key Lab Intelligent Percept & Image Understanding, Joint Int Res Lab Intelligent Percept & Computat, Int Res Ctr Intelligent Percept & Computat,Sch Ar, Xian 710071, Shaanxi, Peoples R China
[2] Xidian Univ, Sch Comp Sci & Technol, Xian Key Lab Big Data & Intelligent Vis, Xian 710071, Shaanxi, Peoples R China
[3] Xidian Univ, Sch Elect Engn, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian 710071, Shaanxi, Peoples R China
来源
IEEE ACCESS | 2019年 / 7卷
基金
中国国家自然科学基金;
关键词
Convolutional neural networks; Siamese networks; change detection; synthetic aperture radar; local descriptor learning; UNSUPERVISED CHANGE DETECTION; SAR IMAGES; FUSION;
D O I
10.1109/ACCESS.2018.2889326
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we present a novel convolutional neural network (CNN)-based model for change detection in synthetic aperture radar (SAR) images. Considering that change detection task takes image pairs as an input, we first explore multiple neural network architectures, which are specifically adapted to the change detection task. There are several ways in which patch pairs can be processed by the network and how information sharing can efficiently learn the semantic difference between the changed and unchanged pixels. For this reason, we then design a "Siamese samples" CNN, which treats patch pairs as indiscriminate samples to extract descriptors and then joins for their outputs. During training, the two patch features are extracted by the same network instead of separate sub-networks, while the joining neuron measures the distance between the two feature vectors. Due to "pseudo-labels" with high accuracy that is difficult to obtain, we modify a joint classifier based on the fuzzy c-means method into joint-similarity classifier as preclassification to obtain coarse "pseudo labels," and discard sample selection. Thus, the preclassification labels with a low accuracy are used to fine-tune the network. Finally, a significantly improved change detection result can be obtained from the network. The proposed architecture provides a better trade-off in terms of speed and accuracy among its counterparts (Siamese, Pseudo-Siamese, and 2-Channel networks). The experiments on several real SAR data sets demonstrate the state-of-the-art performance of the proposed method compared with the advanced change detection methods.
引用
收藏
页码:15389 / 15403
页数:15
相关论文
共 39 条
[1]  
Balntas V., 2016, P IEEE C COMP VIS PA
[2]   An unsupervised approach based on the generalized Gaussian model to automatic change detection in multitemporal SAR images [J].
Bazi, Y ;
Bruzzone, L ;
Melgani, F .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2005, 43 (04) :874-887
[3]   A detail-preserving scale-driven approach to change detection in multitemporal SAR images [J].
Bovolo, F ;
Bruzzone, L .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2005, 43 (12) :2963-2972
[4]  
Bromley J., 1993, International Journal of Pattern Recognition and Artificial Intelligence, V7, P669, DOI 10.1142/S0218001493000339
[5]   Change detection in multisensor SAR images using bivariate gamma distributions [J].
Chatelain, Florent ;
Tourneret, Jean-Yves ;
Inglada, Jordi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2008, 17 (03) :249-258
[6]   A Fuzzy Clustering Approach Toward Hidden Markov Random Field Models for Enhanced Spatially Constrained Image Segmentation [J].
Chatzis, Sotirios P. ;
Varvarigou, Theodora A. .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2008, 16 (05) :1351-1361
[7]   Learning a similarity metric discriminatively, with application to face verification [J].
Chopra, S ;
Hadsell, R ;
LeCun, Y .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :539-546
[8]   FlowNet: Learning Optical Flow with Convolutional Networks [J].
Dosovitskiy, Alexey ;
Fischer, Philipp ;
Ilg, Eddy ;
Haeusser, Philip ;
Hazirbas, Caner ;
Golkov, Vladimir ;
van der Smagt, Patrick ;
Cremers, Daniel ;
Brox, Thomas .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :2758-2766
[9]   Generative Adversarial Networks for Change Detection in Multispectral Imagery [J].
Gong, Maoguo ;
Niu, Xudong ;
Zhang, Puzhao ;
Li, Zhetao .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (12) :2310-2314
[10]   Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks [J].
Gong, Maoguo ;
Zhao, Jiaojiao ;
Liu, Jia ;
Miao, Qiguang ;
Jiao, Licheng .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2016, 27 (01) :125-138