A Siamese Network Based U-Net for Change Detection in High Resolution Remote Sensing Images

被引:80
作者
Chen, Tao [1 ]
Lu, Zhiyuan [1 ,2 ]
Yang, Yue [1 ]
Zhang, Yuxiang [1 ]
Du, Bo [3 ]
Plaza, Antonio [4 ]
机构
[1] China Univ Geosci, Inst Geophys & Geomat, Wuhan 430074, Peoples R China
[2] China Acad Railway Sci Corp Ltd, Inst Comp Technol, Beijing 100081, Peoples R China
[3] Wuhan Univ, Sch Comp Sci, Wuhan 430079, Peoples R China
[4] Univ Extremadura, Escuela Politecn, Dept Technol Comp & Commun, Hyperspectral Comp Lab, Caceres 10071, Spain
基金
中国国家自然科学基金;
关键词
Feature extraction; Object oriented modeling; Biological system modeling; Sensors; Image segmentation; Change detection algorithms; Electronic mail; Attention blocks; change detection (CD); remote sensing; siamese networks; CONVOLUTIONAL NETWORKS;
D O I
10.1109/JSTARS.2022.3157648
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote sensing image change detection (RSICD) is a technique that explores the change of surface coverage in a certain time series by studying the difference between multiple remote sensing images (RSIs) collected over the same area. Traditional RSICD algorithms exhibit poor performance on complex change detection (CD) tasks. In recent years, deep learning (DL) techniques have achieved outstanding results in the fields of RSI segmentation and target recognition. In CD research, most of the methods treat multitemporal remote sensing data as one input and directly apply DL-based image segmentation theory on it while ignoring the spatio-temporal information in these images. In this article, a new siamese neural network is designed by combing an attention mechanism (Siamese_AUNet) with UNet to solve the problems of RSICD algorithms. SiameseNet encodes the feature extraction of RSIs by two branches in the siamese network, respectively. The weights are shared between these two branches in siamese networks. Subsequently, an attention mechanism is added to the model in order to improve its detection ability for changed objects. The models are then compared with conventional neural networks using three benchmark datasets. The results show that the Siamese_AUNet newly proposed in this article exhibits better performance than other standard methods when solving problems related to weak CD and noise suppression.
引用
收藏
页码:2357 / 2369
页数:13
相关论文
共 46 条
[1]   Change Detection in Optical Aerial Images by a Multilayer Conditional Mixed Markov Model [J].
Benedek, Csaba ;
Sziranyi, Tamas .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2009, 47 (10) :3416-3430
[2]   An object-based change detection method accounting for temporal dependences in time series with medium to coarse spatial resolution [J].
Bontemps, Sophie ;
Bogaert, Patrick ;
Titeux, Nicolas ;
Defourny, Pierre .
REMOTE SENSING OF ENVIRONMENT, 2008, 112 (06) :3181-3191
[3]  
Bromley J., 1993, International Journal of Pattern Recognition and Artificial Intelligence, V7, P669, DOI 10.1142/S0218001493000339
[4]   Automatic analysis of the difference image for unsupervised change detection [J].
Bruzzone, L ;
Prieto, DF .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2000, 38 (03) :1171-1182
[5]   Landslide Detection Using Densely Connected Convolutional Networks and Environmental Conditions [J].
Cai, Haojie ;
Chen, Tao ;
Niu, Ruiqing ;
Plaza, Antonio .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :5235-5247
[6]   Automatic change detection in high-resolution remote-sensing images by means of level set evolution and support vector machine classification [J].
Cao, Guo ;
Li, Yupeng ;
Liu, Yazhou ;
Shang, Yanfeng .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2014, 35 (16) :6255-6270
[7]   A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection [J].
Chen, Hao ;
Shi, Zhenwei .
REMOTE SENSING, 2020, 12 (10)
[8]   DASNet: Dual Attentive Fully Convolutional Siamese Networks for Change Detection in High-Resolution Satellite Images [J].
Chen, Jie ;
Yuan, Ziyang ;
Peng, Jian ;
Chen, Li ;
Huang, Haozhe ;
Zhu, Jiawei ;
Liu, Yu ;
Li, Haifeng .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :1194-1206
[9]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[10]   Using remote sensing and GIS to analyse land cover change and its impacts on regional sustainable development [J].
Chen, XW .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2002, 23 (01) :107-124