MPS2L: Mutual Prediction Self-Supervised Learning for Remote Sensing Image Change Detection

被引:1
|
作者
Wang, Qingwang [1 ,2 ]
Qiu, Yujie [1 ,2 ]
Jin, Pengcheng [1 ,2 ]
Shen, Tao [1 ,2 ]
Gu, Yanfeng [3 ,4 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming 650500, Peoples R China
[2] Kunming Univ Sci & Technol, Yunnan Key Lab Comp Technol Applicat, Kunming 650500, Peoples R China
[3] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
[4] Heilongjiang Prov Key Lab Space Air Ground Integra, Harbin 150001, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Feature extraction; Transformers; Remote sensing; Training; Decoding; Image reconstruction; Predictive models; Attention mechanism; masked image modeling (MIM); remote sensing (RS) image change detection (CD); self-supervised learning; BUILDING CHANGE DETECTION; TIME-SERIES; CLASSIFICATION; TRANSFORMERS; DATASET; NETWORK;
D O I
10.1109/TGRS.2024.3468008
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
In this article, we propose a novel mutual prediction self-supervised learning (MPS2L) method for remote sensing (RS) image change detection (CD). Compared with the previous self-supervised CD methods based on contrastive learning (CL), MPS2L employing a pixel-level training strategy based on masked image modeling (MIM) can effectively train the model to interpret the local scene of RS images. Utilizing global and local scenes and temporal change features extracted from masked bitemporal images to achieve cross-temporal mutual prediction makes the model have the ability to understand the overall observation scene and capture the change information. The training of the two abilities is carried out simultaneously, avoiding the problem of multiobjective conflict or mutual inhibition. To better focus on the changing regions in RS scenes, we further introduce a change feature interaction module (CFIM), comprising spatial and channel feature interaction. The channel interaction module (CIM) can facilitate the cross-temporal transmission of global scene information by channel attention, and the spatial interaction module (SIM) can promote the network to capture information on changing regions by spatial attention. The experimental results on three benchmark RS CD datasets demonstrate the effectiveness and priority of our proposed MPS2L compared to some existing state-of-the-art (SOTA) methods. The source code of the proposed MPS2L will be made available publicly at https://github.com/KustTeamWQW/MPS2L.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] SAR Image Change Detection Based on Data Optimization and Self-Supervised Learning
    Meng, Wenhui
    Wang, Liejun
    Du, Anyu
    Li, Yongming
    IEEE ACCESS, 2020, 8 : 217290 - 217305
  • [32] Masked Feature Modeling for Generative Self-Supervised Representation Learning of High-Resolution Remote Sensing Images
    Pang, Shiyan
    Hu, Hanchun
    Zuo, Zhiqi
    Chen, Jia
    Hu, Xiangyun
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 8434 - 8449
  • [33] Domain Adaptable Self-supervised Representation Learning on Remote Sensing Satellite Imagery
    Chopra, Muskaan
    Chhipa, Prakash Chandra
    Mengi, Gopal
    Gupta, Varun
    Liwicki, Marcus
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [34] Spatial-Temporal Based Multihead Self-Attention for Remote Sensing Image Change Detection
    Zhou, Yong
    Wang, Fengkai
    Zhao, Jiaqi
    Yao, Rui
    Chen, Silin
    Ma, Heping
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (10) : 6615 - 6626
  • [35] In-Domain Supervised and Contrastive Self-Supervised Representation Learning for Dense Prediction Problems in Remote Sensing Imageries
    Ghanbarzadeh, Ali
    Soleimani, Hossein
    IEEE ACCESS, 2024, 12 : 183510 - 183524
  • [36] Deep Contrastive Self-Supervised Hashing for Remote Sensing Image Retrieval
    Tan, Xiaoyan
    Zou, Yun
    Guo, Ziyang
    Zhou, Ke
    Yuan, Qiangqiang
    REMOTE SENSING, 2022, 14 (15)
  • [37] TD-SSCD: A Novel Network by Fusing Temporal and Differential Information for Self-Supervised Remote Sensing Image Change Detection
    Qu, Yang
    Li, Jiayi
    Huang, Xin
    Wen, Dawei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [38] Continual Barlow Twins: Continual Self-Supervised Learning for Remote Sensing Semantic Segmentation
    Marsocci, Valerio
    Scardapane, Simone
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 5049 - 5060
  • [39] Self-Supervised Learning for Scene Classification in Remote Sensing: Current State of the Art and Perspectives
    Berg, Paul
    Minh-Tan Pham
    Courty, Nicolas
    REMOTE SENSING, 2022, 14 (16)
  • [40] Reliable Contrastive Learning for Semi-Supervised Change Detection in Remote Sensing Images
    Wang, Jia-Xin
    Li, Teng
    Chen, Si-Bao
    Tang, Jin
    Luo, Bin
    Wilson, Richard C.
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60