SAAN: Similarity-Aware Attention Flow Network for Change Detection With VHR Remote Sensing Images

被引:9
|
作者
Guo, Haonan [1 ]
Su, Xin [2 ]
Wu, Chen [1 ]
Du, Bo [3 ,4 ]
Zhang, Liangpei [1 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430079, Peoples R China
[2] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[3] Wuhan Univ, Inst Artificial Intelligence, Natl Engn Res Ctr Multimedia Software, Sch Comp Sci, Wuhan 430079, Peoples R China
[4] Wuhan Univ, Hubei Key Lab Multimedia & Network Commun Engn, Wuhan 430079, Peoples R China
关键词
Remote sensing image; change detection; similarity measurement; attention mechanism; MAD;
D O I
10.1109/TIP.2024.3349868
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Change detection (CD) is a fundamental and important task for monitoring the land surface dynamics in the earth observation field. Existing deep learning-based CD methods typically extract bi-temporal image features using a weight-sharing Siamese encoder network and identify change regions using a decoder network. These CD methods, however, still perform far from satisfactorily as we observe that 1) deep encoder layers focus on irrelevant background regions; and 2) the models' confidence in the change regions is inconsistent at different decoder stages. The first problem is because deep encoder layers cannot effectively learn from imbalanced change categories using the sole output supervision, while the second problem is attributed to the lack of explicit semantic consistency preservation. To address these issues, we design a novel similarity-aware attention flow network (SAAN). SAAN incorporates a similarity-guided attention flow module with deeply supervised similarity optimization to achieve effective change detection. Specifically, we counter the first issue by explicitly guiding deep encoder layers to discover semantic relations from bi-temporal input images using deeply supervised similarity optimization. The extracted features are optimized to be semantically similar in the unchanged regions and dissimilar in the changing regions. The second drawback can be alleviated by the proposed similarity-guided attention flow module, which incorporates similarity-guided attention modules and attention flow mechanisms to guide the model to focus on discriminative channels and regions. We evaluated the effectiveness and generalization ability of the proposed method by conducting experiments on a wide range of CD tasks. The experimental results demonstrate that our method achieves excellent performance on several CD tasks, with discriminative features and semantic consistency preserved.
引用
收藏
页码:2599 / 2613
页数:15
相关论文
共 50 条
  • [1] Difference Enhancement and SpatialSpectral Nonlocal Network for Change Detection in VHR Remote Sensing Images
    Lei, Tao
    Wang, Jie
    Ning, Hailong
    Wang, Xingwu
    Xue, Dinghua
    Wang, Qi
    Nandi, Asoke K.
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [2] A Dual Neighborhood Hypergraph Neural Network for Change Detection in VHR Remote Sensing Images
    Wu, Junzheng
    Fu, Ruigang
    Liu, Qiang
    Ni, Weiping
    Cheng, Kenan
    Li, Biao
    Sun, Yuli
    arXiv, 2022,
  • [3] Interaction in Transformer for Change Detection in VHR Remote Sensing Images
    Chen, ZiJian
    Song, YongHong
    Ma, Yue
    Li, GuoFu
    Wang, Rui
    Hu, Hao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [4] HFA-Net: High frequency attention siamese network for building change detection in VHR remote sensing images
    Zheng, Hanhong
    Gong, Maoguo
    Liu, Tongfei
    Jiang, Fenlong
    Zhan, Tao
    Lu, Di
    Zhang, Mingyang
    PATTERN RECOGNITION, 2022, 129
  • [5] Bipartite Graph Attention Autoencoders for Unsupervised Change Detection Using VHR Remote Sensing Images
    Jia, Meng
    Zhang, Cheng
    Zhao, Zhiqiang
    Wang, Lei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [6] A Dual Neighborhood Hypergraph Neural Network for Change Detection in VHR Remote Sensing Images
    Wu, Junzheng
    Fu, Ruigang
    Liu, Qiang
    Ni, Weiping
    Cheng, Kenan
    Li, Biao
    Sun, Yuli
    REMOTE SENSING, 2023, 15 (03)
  • [7] Multiscale Visual Attention Networks for Object Detection in VHR Remote Sensing Images
    Wang, Chen
    Bai, Xiao
    Wang, Shuai
    Zhou, Jun
    Ren, Peng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (02) : 310 - 314
  • [8] Global-aware siamese network for change detection on remote sensing images
    Zhang, Ruiqian
    Zhang, Hanchao
    Ning, Xiaogang
    Huang, Xiao
    Wang, Jiaming
    Cui, Wei
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 199 : 61 - 72
  • [9] Explicit Change-Relation Learning for Change Detection in VHR Remote Sensing Images
    Zheng, Dalong
    Wu, Zebin
    Liu, Jia
    Xu, Yang
    Hung, Chih-Cheng
    Wei, Zhihui
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [10] A MULTISCALE CONTEXTUAL APPROACH TO CHANGE DETECTION IN MULTISENSOR VHR REMOTE SENSING IMAGES
    Moser, Gabriele
    De Martino, Michaela
    Serpico, Sebastiano B.
    2013 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2013, : 3435 - 3438