Local Similarity Siamese Network for Urban Land Change Detection on Remote Sensing Images

被引:40
作者
Lee, Haeyun [1 ]
Lee, Kyungsu [1 ]
Kim, Jun Hee [2 ]
Na, Younghwan [1 ]
Park, Juhum [3 ]
Choi, Jihwan P. [4 ]
Hwang, Jae Youn [1 ]
机构
[1] Daegu Gyeongbuk Inst Sci & Technol, Informat & Commun Engn, Daegu 42988, South Korea
[2] Agcy Def Dev, Daejoen 34186, South Korea
[3] Dabeeo Inc, Seoul 04107, South Korea
[4] Korea Adv Inst Sci & Technol, Dept Aerosp Engn, Daejoen 34141, South Korea
基金
新加坡国家研究基金会;
关键词
Remote sensing; Feature extraction; Decoding; Training; Network architecture; Task analysis; Deep learning; Change detection; remote sensing; Siamese network; similarity attention; ATTENTION;
D O I
10.1109/JSTARS.2021.3069242
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Change detection is an important task in the field of remote sensing. Various change detection methods based on convolutional neural networks (CNNs) have recently been proposed for remote sensing using satellite or aerial images. However, existing methods allow only the partial use of content information in images during change detection because they adopt simple feature similarity measurements or pixel-level loss functions to construct their network architectures. Therefore, when these methods are applied to complex urban areas, their performance in terms of change detection tends to be limited. In this article, a novel CNN-based change detection approach, referred to as a local similarity Siamese network (LSS-Net), with a cosine similarity measurement, was proposed for better urban land change detection in remote sensing images. To use content information on two sequential images, a new change attention map-based content loss function was developed in this study. In addition, to enhance the performance of the LSS-Net in terms of change detection, a suitable feature similarity measurement method, incorporated into a local similarity attention module, was determined through systemic experiments. To verify the change detection performance of the LSS-Net, it was compared with other state-of-the-art methods. The experimental results show that the proposed method outperforms the state-of-the-art methods in terms of the F1 score (0.9630, 0.9377, and 0.7751) and kappa (0.9581, 0.9351, and 0.7646) on the three test datasets, thus suggesting its potential for various remote sensing applications.
引用
收藏
页码:4139 / 4149
页数:11
相关论文
共 36 条
[11]   Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1026-1034
[12]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/CVPR.2018.00745, 10.1109/TPAMI.2019.2913372]
[13]   Recurrently exploring class-wise attention in a hybrid convolutional and bidirectional LSTM network for multi-label aerial image classification [J].
Hua, Yuansheng ;
Mou, Lichao ;
Zhu, Xiao Xiang .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2019, 149 :188-199
[14]   Fully Convolutional Networks for Multisource Building Extraction From an Open Aerial and Satellite Imagery Data Set [J].
Ji, Shunping ;
Wei, Shiqing ;
Lu, Meng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (01) :574-586
[15]   A Deep Convolutional Coupling Network for Change Detection Based on Heterogeneous Optical and Radar Images [J].
Liu, Jia ;
Gong, Maoguo ;
Qin, Kai ;
Zhang, Puzhao .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (03) :545-559
[16]   PGA-SiamNet: Pyramid Feature-Based Attention-Guided Siamese Network for Remote Sensing Orthoimagery Building Change Detection [J].
Jiang, Huiwei ;
Hu, Xiangyun ;
Li, Kun ;
Zhang, Jinming ;
Gong, Jinqi ;
Zhang, Mi .
REMOTE SENSING, 2020, 12 (03)
[17]   Perceptual Losses for Real-Time Style Transfer and Super-Resolution [J].
Johnson, Justin ;
Alahi, Alexandre ;
Li Fei-Fei .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :694-711
[18]   Objects Segmentation From High-Resolution Aerial Images Using U-Net With Pyramid Pooling Layers [J].
Kim, Jun Hee ;
Lee, Haeyun ;
Hong, Seonghwan J. ;
Kim, Sewoong ;
Park, Juhum ;
Hwang, Jae Youn ;
Choi, Jihwan P. .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (01) :115-119
[19]  
King DB, 2015, ACS SYM SER, V1214, P1, DOI 10.1021/bk-2015-1214.ch001
[20]   Landslide Inventory Mapping From Bitemporal Images Using Deep Convolutional Neural Networks [J].
Lei, Tao ;
Zhang, Yuxiao ;
Lv, Zhiyong ;
Li, Shuying ;
Liu, Shigang ;
Nandi, Asoke K. .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (06) :982-986