MPS2L: Mutual Prediction Self-Supervised Learning for Remote Sensing Image Change Detection

被引:1
|
作者
Wang, Qingwang [1 ,2 ]
Qiu, Yujie [1 ,2 ]
Jin, Pengcheng [1 ,2 ]
Shen, Tao [1 ,2 ]
Gu, Yanfeng [3 ,4 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming 650500, Peoples R China
[2] Kunming Univ Sci & Technol, Yunnan Key Lab Comp Technol Applicat, Kunming 650500, Peoples R China
[3] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
[4] Heilongjiang Prov Key Lab Space Air Ground Integra, Harbin 150001, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Feature extraction; Transformers; Remote sensing; Training; Decoding; Image reconstruction; Predictive models; Attention mechanism; masked image modeling (MIM); remote sensing (RS) image change detection (CD); self-supervised learning; BUILDING CHANGE DETECTION; TIME-SERIES; CLASSIFICATION; TRANSFORMERS; DATASET; NETWORK;
D O I
10.1109/TGRS.2024.3468008
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
In this article, we propose a novel mutual prediction self-supervised learning (MPS2L) method for remote sensing (RS) image change detection (CD). Compared with the previous self-supervised CD methods based on contrastive learning (CL), MPS2L employing a pixel-level training strategy based on masked image modeling (MIM) can effectively train the model to interpret the local scene of RS images. Utilizing global and local scenes and temporal change features extracted from masked bitemporal images to achieve cross-temporal mutual prediction makes the model have the ability to understand the overall observation scene and capture the change information. The training of the two abilities is carried out simultaneously, avoiding the problem of multiobjective conflict or mutual inhibition. To better focus on the changing regions in RS scenes, we further introduce a change feature interaction module (CFIM), comprising spatial and channel feature interaction. The channel interaction module (CIM) can facilitate the cross-temporal transmission of global scene information by channel attention, and the spatial interaction module (SIM) can promote the network to capture information on changing regions by spatial attention. The experimental results on three benchmark RS CD datasets demonstrate the effectiveness and priority of our proposed MPS2L compared to some existing state-of-the-art (SOTA) methods. The source code of the proposed MPS2L will be made available publicly at https://github.com/KustTeamWQW/MPS2L.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Self-Supervised Learning in Remote Sensing
    Wang, Yi
    Albrecht, Conrad M.
    Ait Ali Braham, Nassim
    Mou, Lichao
    Zhu, Xiao Xiang
    IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2022, 10 (04) : 213 - 247
  • [2] Self-Supervised Representation Learning for Remote Sensing Image Change Detection Based on Temporal Prediction
    Dong, Huihui
    Ma, Wenping
    Wu, Yue
    Zhang, Jun
    Jiao, Licheng
    REMOTE SENSING, 2020, 12 (11)
  • [3] In-Domain Self-Supervised Learning Improves Remote Sensing Image Scene Classification
    Dimitrovski, Ivica
    Kitanovski, Ivan
    Simidjievski, Nikola
    Kocev, Dragi
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [4] Pattern Integration and Enhancement Vision Transformer for Self-Supervised Learning in Remote Sensing
    Lu, Kaixuan
    Zhang, Ruiqian
    Huang, Xiao
    Xie, Yuxing
    Ning, Xiaogang
    Zhang, Hanchao
    Yuan, Mengke
    Zhang, Pan
    Wang, Tao
    Liao, Tongkui
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [5] Self-supervised multimodal change detection based on difference contrast learning for remote sensing imagery
    Hou, Xuan
    Bai, Yunpeng
    Xie, Yefan
    Zhang, Yunfeng
    Fu, Lei
    Li, Ying
    Shang, Changjing
    Shen, Qiang
    PATTERN RECOGNITION, 2025, 159
  • [6] Self-Supervised Feature Learning for Multimodal Remote Sensing Image Land Cover Classification
    Xue, Zhixiang
    Yu, Xuchu
    Yu, Anzhu
    Liu, Bing
    Zhang, Pengqiang
    Wu, Shentong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [7] Domain Knowledge-Guided Self-Supervised Change Detection for Remote Sensing Images
    Yan, Li
    Yang, Jianbing
    Wang, Jian
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 4167 - 4179
  • [8] Multicue Contrastive Self-Supervised Learning for Change Detection in Remote Sensing
    Yang, Meijuan
    Jiao, Licheng
    Liu, Fang
    Hou, Biao
    Yang, Shuyuan
    Zhang, Yake
    Wang, Jianlong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61 : 1 - 14
  • [9] Self-Supervised Change Detection in Multiview Remote Sensing Images
    Chen, Yuxing
    Bruzzone, Lorenzo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [10] Contrastive Self-Supervised Learning With Smoothed Representation for Remote Sensing
    Jung, Heechul
    Oh, Yoonju
    Jeong, Seongho
    Lee, Chaehyeon
    Jeon, Taegyun
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19