A deep translation (GAN) based change detection network for optical and SAR remote sensing images

被引:291
作者
Li, Xinghua [1 ]
Du, Zhengshun [1 ]
Huang, Yanyuan [1 ]
Tan, Zhenyu [2 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Northwest Univ, Coll Urban & Environm Sci, Xian 710127, Peoples R China
基金
中国国家自然科学基金;
关键词
Change detection; Deep translation; Depthwise separable convolution; GAN; Multi-scale loss; Optical and SAR images; CLASSIFICATION;
D O I
10.1016/j.isprsjprs.2021.07.007
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
With the development of space-based imaging technology, a larger and larger number of images with different modalities and resolutions are available. The optical images reflect the abundant spectral information and geometric shape of ground objects, whose qualities are degraded easily in poor atmospheric conditions. Although synthetic aperture radar (SAR) images cannot provide the spectral features of the region of interest (ROI), they can capture all-weather and all-time polarization information. In nature, optical and SAR images encapsulate lots of complementary information, which is of great significance for change detection (CD) in poor weather situations. However, due to the difference in imaging mechanisms of optical and SAR images, it is difficult to conduct their CD directly using the traditional difference or ratio algorithms. Most recent CD methods bring image translation to reduce their difference, but the results are obtained by ordinary algebraic methods and threshold segmentation with limited accuracy. Towards this end, this work proposes a d eep translation based change detection network (DTCDN) for optical and SAR images. The deep translation firstly maps images from one domain (e.g., optical) to another domain (e.g., SAR) through a cyclic structure into the same feature space. With the similar characteristics after deep translation, they become comparable. Different from most previous researches, the translation results are imported to a supervised CD network that utilizes deep context features to separate the unchanged pixels and changed pixels. In the experiments, the proposed DTCDN was tested on four representative data sets from Gloucester, California, and Shuguang village. Compared with state-of-the-art methods, the effectiveness and robustness of the proposed method were confirmed.
引用
收藏
页码:14 / 34
页数:21
相关论文
共 73 条
[51]   Dense connection and depthwise separable convolution based CNN for polarimetric SAR image classification [J].
Shang, Ronghua ;
He, Jianghai ;
Wang, Jiaming ;
Xu, Kaiming ;
Jiao, Licheng ;
Stolkin, Rustam .
KNOWLEDGE-BASED SYSTEMS, 2020, 194
[52]   Domain Adaption for Fine-Grained Urban Village Extraction From Satellite Images [J].
Shi, Qian ;
Liu, Mengxi ;
Liu, Xiaoping ;
Liu, Penghua ;
Zhang, Pengyuan ;
Yang, Jinxing ;
Li, Xia .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (08) :1430-1434
[54]   Automatic Post-Disaster Damage Mapping Using Deep-Learning Techniques for Change Detection: Case Study of the Tohoku Tsunami [J].
Sublime, Jeremie ;
Kalinicheva, Ekaterina .
REMOTE SENSING, 2019, 11 (09)
[55]   Structure Consistency-Based Graph for Unsupervised Change Detection With Homogeneous and Heterogeneous Remote Sensing Images [J].
Sun, Yuli ;
Lei, Lin ;
Li, Xiao ;
Tan, Xiang ;
Kuang, Gangyao .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[56]   Patch Similarity Graph Matrix-Based Unsupervised Remote Sensing Change Detection With Homogeneous and Heterogeneous Sensors [J].
Sun, Yuli ;
Lei, Lin ;
Li, Xiao ;
Tan, Xiang ;
Kuang, Gangyao .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (06) :4841-4861
[57]   Nonlocal patch similarity based heterogeneous remote sensing change detection [J].
Sun, Yuli ;
Lei, Lin ;
Li, Xiao ;
Sun, Hao ;
Kuang, Gangyao .
PATTERN RECOGNITION, 2021, 109
[58]   Building Change Detection Based on Satellite Stereo Imagery and Digital Surface Models [J].
Tian, Jiaojiao ;
Cui, Shiyong ;
Reinartz, Peter .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (01) :406-417
[59]   Detection of urban sprawl using a genetic algorithm-evolved artificial neural network classification in remote sensing: a case study in Jiading and Putuo districts of Shanghai, China [J].
Tong, Xiaohua ;
Zhang, Xue ;
Liu, Miaolong .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2010, 31 (06) :1485-1504
[60]  
Touati R., 2020, J. Remote Sens. GIS, V9, P1