Local Similarity Siamese Network for Urban Land Change Detection on Remote Sensing Images

被引:40
作者
Lee, Haeyun [1 ]
Lee, Kyungsu [1 ]
Kim, Jun Hee [2 ]
Na, Younghwan [1 ]
Park, Juhum [3 ]
Choi, Jihwan P. [4 ]
Hwang, Jae Youn [1 ]
机构
[1] Daegu Gyeongbuk Inst Sci & Technol, Informat & Commun Engn, Daegu 42988, South Korea
[2] Agcy Def Dev, Daejoen 34186, South Korea
[3] Dabeeo Inc, Seoul 04107, South Korea
[4] Korea Adv Inst Sci & Technol, Dept Aerosp Engn, Daejoen 34141, South Korea
基金
新加坡国家研究基金会;
关键词
Remote sensing; Feature extraction; Decoding; Training; Network architecture; Task analysis; Deep learning; Change detection; remote sensing; Siamese network; similarity attention; ATTENTION;
D O I
10.1109/JSTARS.2021.3069242
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Change detection is an important task in the field of remote sensing. Various change detection methods based on convolutional neural networks (CNNs) have recently been proposed for remote sensing using satellite or aerial images. However, existing methods allow only the partial use of content information in images during change detection because they adopt simple feature similarity measurements or pixel-level loss functions to construct their network architectures. Therefore, when these methods are applied to complex urban areas, their performance in terms of change detection tends to be limited. In this article, a novel CNN-based change detection approach, referred to as a local similarity Siamese network (LSS-Net), with a cosine similarity measurement, was proposed for better urban land change detection in remote sensing images. To use content information on two sequential images, a new change attention map-based content loss function was developed in this study. In addition, to enhance the performance of the LSS-Net in terms of change detection, a suitable feature similarity measurement method, incorporated into a local similarity attention module, was determined through systemic experiments. To verify the change detection performance of the LSS-Net, it was compared with other state-of-the-art methods. The experimental results show that the proposed method outperforms the state-of-the-art methods in terms of the F1 score (0.9630, 0.9377, and 0.7751) and kappa (0.9581, 0.9351, and 0.7646) on the three test datasets, thus suggesting its potential for various remote sensing applications.
引用
收藏
页码:4139 / 4149
页数:11
相关论文
共 36 条
[1]   Advances in Remote Sensing of Agriculture: Context Description, Existing Operational Monitoring Systems and Major Information Needs [J].
Atzberger, Clement .
REMOTE SENSING, 2013, 5 (02) :949-981
[2]   Change Detection in Optical Aerial Images by a Multilayer Conditional Mixed Markov Model [J].
Benedek, Csaba ;
Sziranyi, Tamas .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2009, 47 (10) :3416-3430
[3]   CONSTRAINED OPTICAL FLOW FOR AERIAL IMAGE CHANGE DETECTION [J].
Bourdis, Nicolas ;
Marraud, Denis ;
Sahbi, Hichem .
2011 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2011, :4176-4179
[4]   Remote Sensing Image Classification Based on a Cross-Attention Mechanism and Graph Convolution [J].
Cai, Weiwei ;
Wei, Zhanguo .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[5]   A Convenient and Robust Test to Quantify Interocular Suppression for Children With Amblyopia [J].
Chen, Hui ;
He, Zhifen ;
Xu, Jinling ;
Mao, Yu ;
Liang, Yunjie ;
Lin, Danli ;
Xu, Meiping ;
Dai, Zhiyue ;
Chen, Xiaoxin ;
Zhou, Jiawei ;
Yu, Xinping .
I-PERCEPTION, 2019, 10 (04)
[6]   Detection of building changes from aerial images and light detection and ranging (LIDAR) data [J].
Chen, Liang-Chien ;
Lin, Li-Jer .
JOURNAL OF APPLIED REMOTE SENSING, 2010, 4
[7]   A COEFFICIENT OF AGREEMENT FOR NOMINAL SCALES [J].
COHEN, J .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1960, 20 (01) :37-46
[8]   Digital change detection methods in ecosystem monitoring: a review [J].
Coppin, P ;
Jonckheere, I ;
Nackaerts, K ;
Muys, B ;
Lambin, E .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2004, 25 (09) :1565-1596
[9]  
Daudt RC, 2018, IEEE IMAGE PROC, P4063, DOI 10.1109/ICIP.2018.8451652
[10]   FlowNet: Learning Optical Flow with Convolutional Networks [J].
Dosovitskiy, Alexey ;
Fischer, Philipp ;
Ilg, Eddy ;
Haeusser, Philip ;
Hazirbas, Caner ;
Golkov, Vladimir ;
van der Smagt, Patrick ;
Cremers, Daniel ;
Brox, Thomas .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :2758-2766