DSQNet: Enhancing Change Detection Network via Deep Semantics Query for Remote Sensing Images

被引:0
作者
Qin, Zilin [1 ,2 ]
Zhang, Lefei [1 ,2 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Peoples R China
[2] Hubei Luojia Lab, Wuhan 430079, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Semantics; Vectors; Convolution; Transformers; Remote sensing; Head; Fuses; Filtering; Sensors; Change detection; convolution layer; local regions interaction; remote sensing (RS);
D O I
10.1109/LGRS.2024.3474181
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Change detection from remote sensing (RS) images has made significant progress in many applications including environmental protection and agricultural monitoring. Recently, RS change detection algorithms mainly focus on feature interaction between the bitemporal images. However, there is a challenge in existing methods regarding how to focus more attention on local prominent features and specifically enhance their salience during the interaction of representations. For this issue, this letter presents a change detection network DSQNet that marks multiple regions of interest using query vectors with deep semantics and explicitly searches the heterogeneous features for focused interaction. Specifically, DSQNet uses bidirectional matching query (BMQ) module to effectively perceive local relevant features by feature space query for cross matching and adequately enhance the context relationship within specific regions during the interaction, which helps the model better learn the idea of potential change. Moreover, to make the query vectors and the feature representation aligned in the semantic space, we further propose the deep semantic adjustment feature pyramid (DSP) module. It realizes interlayer feature adjustment from the inside out in the pyramid and enables query vectors to represent extremely rich semantics, improving query efficiency. Experimental results on four benchmark datasets show that DSQNet achieves better performance than other advanced change detection networks. The codes are available at https://github.com/QinZelin/DSQNet/.
引用
收藏
页数:5
相关论文
共 19 条
  • [1] A TRANSFORMER-BASED SIAMESE NETWORK FOR CHANGE DETECTION
    Bandara, Wele Gedara Chaminda
    Patel, Vishal M.
    [J]. 2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 207 - 210
  • [2] Remote Sensing Image Change Detection With Transformers
    Chen, Hao
    Qi, Zipeng
    Shi, Zhenwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [3] A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection
    Chen, Hao
    Shi, Zhenwei
    [J]. REMOTE SENSING, 2020, 12 (10)
  • [4] Daudt RC, 2018, IEEE IMAGE PROC, P4063, DOI 10.1109/ICIP.2018.8451652
  • [5] Adapting Segment Anything Model for Change Detection in VHR Remote Sensing Images
    Ding, Lei
    Zhu, Kun
    Peng, Daifeng
    Tang, Hao
    Yang, Kuiwu
    Bruzzone, Lorenzo
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 11
  • [6] Changer: Feature Interaction is What You Need for Change Detection
    Fang, Sheng
    Li, Kaiyu
    Li, Zhe
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [7] AANet: An Ambiguity-Aware Network for Remote-Sensing Image Change Detection
    Hang, Renlong
    Xu, Siqi
    Yuan, Panli
    Liu, Qingshan
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 11
  • [8] He KM, 2017, IEEE I CONF COMP VIS, P2980, DOI [10.1109/TPAMI.2018.2844175, 10.1109/ICCV.2017.322]
  • [9] Lebedev M., 2018, Int. Arch. Photogramm., Remote Sens. Spatial Inf. Sci., V42, P565, DOI DOI 10.5194/ISPRS-ARCHIVES-XLII-2-565-2018
  • [10] Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
    Liu, Ze
    Lin, Yutong
    Cao, Yue
    Hu, Han
    Wei, Yixuan
    Zhang, Zheng
    Lin, Stephen
    Guo, Baining
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 9992 - 10002