Laplacian Pyramid Network With Hybrid Encoder and Edge Guidance for Remote Sensing Change Detection

被引:0
作者
Yan, Wenkai [1 ]
Liu, Yikun [1 ]
Li, Mingsong [1 ]
Zhang, Ruifan [1 ]
Yang, Gongping [1 ]
机构
[1] Shandong Univ, Sch Software, Jinan 250100, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Transformers; Remote sensing; Image edge detection; Laplace equations; Accuracy; Deep learning; Decoding; Image reconstruction; Data mining; Change detection (CD); edge guidance; hybrid encoder; Laplacian pyramid (LP); remote sensing (RS) image;
D O I
10.1109/JSTARS.2024.3491762
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote sensing change detection (CD) is a crucial task for observing and analyzing dynamic land cover alterations. Many CD methods based on deep learning demonstrate strong performance, but their effectiveness is influenced by the choice of encoder and the challenge of accurately delineating the edges of change regions. In this article, we propose a Laplacian pyramid network with hybrid encoder and edge guidance (HE-LPNet) to solve these issues. Specifically, the hybrid encoder combines the advantages of convolutional neural networks and transformer, resulting in extracted features that are more fine-grained. Meanwhile, the hybrid encoder incorporates the vision foundation models, leading to enhanced generalization of the overall model. In addition to feature extraction, the image is processed to generate a Laplacian pyramid, which is then fused with the features extracted by the hybrid encoder to enhance the salient features at the pixel-level. In the decoder stage, weighted guided attention is designed to selectively apply channel and spatial attention to the fused features, improving the network's ability to discriminate change regions. Furthermore, we present an edge-guided loss to capture edge information in change regions. To validate the effectiveness of the proposed HE-LPNet, extensive experiments are conducted on three high-resolution remote sensing CD datasets. The experimental results demonstrate that our method surpasses other state-of-the-art CD methods.
引用
收藏
页码:160 / 175
页数:16
相关论文
共 63 条
  • [1] Street-view change detection with deconvolutional networks
    Alcantarilla, Pablo F.
    Stent, Simon
    Ros, German
    Arroyo, Roberto
    Gherardi, Riccardo
    [J]. AUTONOMOUS ROBOTS, 2018, 42 (07) : 1301 - 1322
  • [2] Edge-Guided Recurrent Convolutional Neural Network for Multitemporal Remote Sensing Image Building Change Detection
    Bai, Beifang
    Fu, Wei
    Lu, Ting
    Li, Shutao
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [3] A TRANSFORMER-BASED SIAMESE NETWORK FOR CHANGE DETECTION
    Bandara, Wele Gedara Chaminda
    Patel, Vishal M.
    [J]. 2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 207 - 210
  • [4] Earthquake Damage Assessment of Buildings Using VHR Optical and SAR Imagery
    Brunner, Dominik
    Lemoine, Guido
    Bruzzone, Lorenzo
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2010, 48 (05): : 2403 - 2420
  • [5] THE LAPLACIAN PYRAMID AS A COMPACT IMAGE CODE
    BURT, PJ
    ADELSON, EH
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 1983, 31 (04) : 532 - 540
  • [6] Pre-Trained Image Processing Transformer
    Chen, Hanting
    Wang, Yunhe
    Guo, Tianyu
    Xu, Chang
    Deng, Yiping
    Liu, Zhenhua
    Ma, Siwei
    Xu, Chunjing
    Xu, Chao
    Gao, Wen
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12294 - 12305
  • [7] Remote Sensing Image Change Detection With Transformers
    Chen, Hao
    Qi, Zipeng
    Shi, Zhenwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [8] A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection
    Chen, Hao
    Shi, Zhenwei
    [J]. REMOTE SENSING, 2020, 12 (10)
  • [9] RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation Based on Visual Foundation Model
    Chen, Keyan
    Liu, Chenyang
    Chen, Hao
    Zhang, Haotian
    Li, Wenyuan
    Zou, Zhengxia
    Shi, Zhenwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 17
  • [10] Chen M, 2020, PR MACH LEARN RES, V119