SAAN: Similarity-Aware Attention Flow Network for Change Detection With VHR Remote Sensing Images

被引:17
作者
Guo, Haonan [1 ]
Su, Xin [2 ]
Wu, Chen [1 ]
Du, Bo [3 ,4 ]
Zhang, Liangpei [1 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430079, Peoples R China
[2] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[3] Wuhan Univ, Inst Artificial Intelligence, Natl Engn Res Ctr Multimedia Software, Sch Comp Sci, Wuhan 430079, Peoples R China
[4] Wuhan Univ, Hubei Key Lab Multimedia & Network Commun Engn, Wuhan 430079, Peoples R China
关键词
Remote sensing image; change detection; similarity measurement; attention mechanism; MAD;
D O I
10.1109/TIP.2024.3349868
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Change detection (CD) is a fundamental and important task for monitoring the land surface dynamics in the earth observation field. Existing deep learning-based CD methods typically extract bi-temporal image features using a weight-sharing Siamese encoder network and identify change regions using a decoder network. These CD methods, however, still perform far from satisfactorily as we observe that 1) deep encoder layers focus on irrelevant background regions; and 2) the models' confidence in the change regions is inconsistent at different decoder stages. The first problem is because deep encoder layers cannot effectively learn from imbalanced change categories using the sole output supervision, while the second problem is attributed to the lack of explicit semantic consistency preservation. To address these issues, we design a novel similarity-aware attention flow network (SAAN). SAAN incorporates a similarity-guided attention flow module with deeply supervised similarity optimization to achieve effective change detection. Specifically, we counter the first issue by explicitly guiding deep encoder layers to discover semantic relations from bi-temporal input images using deeply supervised similarity optimization. The extracted features are optimized to be semantically similar in the unchanged regions and dissimilar in the changing regions. The second drawback can be alleviated by the proposed similarity-guided attention flow module, which incorporates similarity-guided attention modules and attention flow mechanisms to guide the model to focus on discriminative channels and regions. We evaluated the effectiveness and generalization ability of the proposed method by conducting experiments on a wide range of CD tasks. The experimental results demonstrate that our method achieves excellent performance on several CD tasks, with discriminative features and semantic consistency preserved.
引用
收藏
页码:2599 / 2613
页数:15
相关论文
共 61 条
[1]   Polarimetric SAR Time Series Change Analysis Over Agricultural Areas [J].
Alonso-Gonzalez, Alberto ;
Lopez-Martinez, Carlos ;
Papathanassiou, Konstantinos P. ;
Hajnsek, Irena .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (10) :7317-7330
[2]   Edge-Guided Recurrent Convolutional Neural Network for Multitemporal Remote Sensing Image Building Change Detection [J].
Bai, Beifang ;
Fu, Wei ;
Lu, Ting ;
Li, Shutao .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[3]   Deep learning for change detection in remote sensing: a review [J].
Bai, Ting ;
Wang, Le ;
Yin, Dameng ;
Sun, Kaimin ;
Chen, Yepei ;
Li, Wenzhuo ;
Li, Deren .
GEO-SPATIAL INFORMATION SCIENCE, 2023, 26 (03) :262-288
[4]  
Bandara WGC, 2022, Arxiv, DOI arXiv:2201.01293
[5]   Detection of land-cover transitions by combining multidate classifiers [J].
Bruzzone, L ;
Cossu, R ;
Vernazza, G .
PATTERN RECOGNITION LETTERS, 2004, 25 (13) :1491-1500
[6]   Remote Sensing Image Change Detection With Transformers [J].
Chen, Hao ;
Qi, Zipeng ;
Shi, Zhenwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[7]   A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection [J].
Chen, Hao ;
Shi, Zhenwei .
REMOTE SENSING, 2020, 12 (10)
[8]  
Chen HRX, 2022, Arxiv, DOI [arXiv:2201.10953, DOI 10.48550/ARXIV.2201.10953]
[9]  
Chen HRX, 2020, Arxiv, DOI arXiv:1906.11479
[10]   Change Detection in Multisource VHR Images via Deep Siamese Convolutional Multiple-Layers Recurrent Neural Network [J].
Chen, Hongruixuan ;
Wu, Chen ;
Du, Bo ;
Zhang, Liangpei ;
Wang, Le .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (04) :2848-2864