A Siamese Network Based U-Net for Change Detection in High Resolution Remote Sensing Images

被引:80
作者
Chen, Tao [1 ]
Lu, Zhiyuan [1 ,2 ]
Yang, Yue [1 ]
Zhang, Yuxiang [1 ]
Du, Bo [3 ]
Plaza, Antonio [4 ]
机构
[1] China Univ Geosci, Inst Geophys & Geomat, Wuhan 430074, Peoples R China
[2] China Acad Railway Sci Corp Ltd, Inst Comp Technol, Beijing 100081, Peoples R China
[3] Wuhan Univ, Sch Comp Sci, Wuhan 430079, Peoples R China
[4] Univ Extremadura, Escuela Politecn, Dept Technol Comp & Commun, Hyperspectral Comp Lab, Caceres 10071, Spain
基金
中国国家自然科学基金;
关键词
Feature extraction; Object oriented modeling; Biological system modeling; Sensors; Image segmentation; Change detection algorithms; Electronic mail; Attention blocks; change detection (CD); remote sensing; siamese networks; CONVOLUTIONAL NETWORKS;
D O I
10.1109/JSTARS.2022.3157648
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote sensing image change detection (RSICD) is a technique that explores the change of surface coverage in a certain time series by studying the difference between multiple remote sensing images (RSIs) collected over the same area. Traditional RSICD algorithms exhibit poor performance on complex change detection (CD) tasks. In recent years, deep learning (DL) techniques have achieved outstanding results in the fields of RSI segmentation and target recognition. In CD research, most of the methods treat multitemporal remote sensing data as one input and directly apply DL-based image segmentation theory on it while ignoring the spatio-temporal information in these images. In this article, a new siamese neural network is designed by combing an attention mechanism (Siamese_AUNet) with UNet to solve the problems of RSICD algorithms. SiameseNet encodes the feature extraction of RSIs by two branches in the siamese network, respectively. The weights are shared between these two branches in siamese networks. Subsequently, an attention mechanism is added to the model in order to improve its detection ability for changed objects. The models are then compared with conventional neural networks using three benchmark datasets. The results show that the Siamese_AUNet newly proposed in this article exhibits better performance than other standard methods when solving problems related to weak CD and noise suppression.
引用
收藏
页码:2357 / 2369
页数:13
相关论文
共 46 条
[11]   Digital change detection methods in ecosystem monitoring: a review [J].
Coppin, P ;
Jonckheere, I ;
Nackaerts, K ;
Muys, B ;
Lambin, E .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2004, 25 (09) :1565-1596
[12]   Unsupervised Deep Slow Feature Analysis for Change Detection in Multi-Temporal Remote Sensing Images [J].
Du, Bo ;
Ru, Lixiang ;
Wu, Chen ;
Zhang, Liangpei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (12) :9976-9992
[13]   Convolutional Neural Network Features Based Change Detection in Satellite Images [J].
El Amin, Arabi Mohammed ;
Liu, Qingjie ;
Wang, Yunhong .
FIRST INTERNATIONAL WORKSHOP ON PATTERN RECOGNITION, 2016, 0011
[14]   Object-oriented change detection for the city of Harare, Zimbabwe [J].
Gamanya, Ruvimbo ;
De Maeyer, Philippe ;
De Dapper, Morgan .
EXPERT SYSTEMS WITH APPLICATIONS, 2009, 36 (01) :571-588
[15]   Recognition and Mapping of Landslide Using a Fully Convolutional DenseNet and Influencing Factors [J].
Gao, Xiao ;
Chen, Tao ;
Niu, Ruiqing ;
Plaza, Antonio .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :7881-7894
[16]   Change Detection From Synthetic Aperture Radar Images Based on Channel Weighting-Based Deep Cascade Network [J].
Gao, Yunhao ;
Gao, Feng ;
Dong, Junyu ;
Wang, Shengke .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2019, 12 (11) :4517-4529
[17]  
Guo E., 2018, ARXIV181009111
[18]   Unsupervised Change Detection With Expectation-Maximization-Based Level Set [J].
Hao, Ming ;
Shi, Wenzhong ;
Zhang, Hua ;
Li, Chang .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2014, 11 (01) :210-214
[19]  
He KM, 2014, LECT NOTES COMPUT SC, V8691, P346, DOI [arXiv:1406.4729, 10.1007/978-3-319-10578-9_23]
[20]   Seasonal Change of Land-Use/Land-Cover (LULC) Detection Using MODIS Data in Rapid Urbanization Regions: A Case Study of the Pearl River Delta Region (China) [J].
Hu, Jinrong ;
Zhang, Yuanzhi .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2013, 6 (04) :1913-1920