MPS2L: Mutual Prediction Self-Supervised Learning for Remote Sensing Image Change Detection

被引:1
|
作者
Wang, Qingwang [1 ,2 ]
Qiu, Yujie [1 ,2 ]
Jin, Pengcheng [1 ,2 ]
Shen, Tao [1 ,2 ]
Gu, Yanfeng [3 ,4 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming 650500, Peoples R China
[2] Kunming Univ Sci & Technol, Yunnan Key Lab Comp Technol Applicat, Kunming 650500, Peoples R China
[3] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
[4] Heilongjiang Prov Key Lab Space Air Ground Integra, Harbin 150001, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
基金
中国国家自然科学基金;
关键词
Feature extraction; Transformers; Remote sensing; Training; Decoding; Image reconstruction; Predictive models; Attention mechanism; masked image modeling (MIM); remote sensing (RS) image change detection (CD); self-supervised learning; BUILDING CHANGE DETECTION; TIME-SERIES; CLASSIFICATION; TRANSFORMERS; DATASET; NETWORK;
D O I
10.1109/TGRS.2024.3468008
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
In this article, we propose a novel mutual prediction self-supervised learning (MPS2L) method for remote sensing (RS) image change detection (CD). Compared with the previous self-supervised CD methods based on contrastive learning (CL), MPS2L employing a pixel-level training strategy based on masked image modeling (MIM) can effectively train the model to interpret the local scene of RS images. Utilizing global and local scenes and temporal change features extracted from masked bitemporal images to achieve cross-temporal mutual prediction makes the model have the ability to understand the overall observation scene and capture the change information. The training of the two abilities is carried out simultaneously, avoiding the problem of multiobjective conflict or mutual inhibition. To better focus on the changing regions in RS scenes, we further introduce a change feature interaction module (CFIM), comprising spatial and channel feature interaction. The channel interaction module (CIM) can facilitate the cross-temporal transmission of global scene information by channel attention, and the spatial interaction module (SIM) can promote the network to capture information on changing regions by spatial attention. The experimental results on three benchmark RS CD datasets demonstrate the effectiveness and priority of our proposed MPS2L compared to some existing state-of-the-art (SOTA) methods. The source code of the proposed MPS2L will be made available publicly at https://github.com/KustTeamWQW/MPS2L.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Self-Supervised Edge Perceptual Learning Framework for High-Resolution Remote Sensing Images Classification
    Li, Guangfei
    Liu, Wenbing
    Gao, Quanxue
    Wang, Qianqian
    Han, Jungong
    Gao, Xinbo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 6024 - 6038
  • [22] Semi- and Self-Supervised Metric Learning for Remote Sensing Applications
    Hernandez-Sequeira, Itza
    Fernandez-Beltran, Ruben
    Pla, Filiberto
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [23] A Hyperspectral Image Change Detection Framework With Self-Supervised Contrastive Learning Pretrained Model
    Ou, Xianfeng
    Liu, Liangzhen
    Tan, Shulun
    Zhang, Guoyun
    Li, Wujing
    Tu, Bing
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 7724 - 7740
  • [24] A General Self-Supervised Framework for Remote Sensing Image Classification
    Gao, Yuan
    Sun, Xiaojuan
    Liu, Chao
    REMOTE SENSING, 2022, 14 (19)
  • [25] Prototype Discriminative Learning for Semi-Supervised Change Detection in Remote Sensing Images
    You, Zhi-Hui
    Chen, Si-Bao
    Wang, Jia-Xin
    Ding, Chris H. Q.
    Tang, Jin
    Luo, Bin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [26] TOV: The Original Vision Model for Optical Remote Sensing Image Understanding via Self-Supervised Learning
    Tao, Chao
    Qi, Ji
    Zhang, Guo
    Zhu, Qing
    Lu, Weipeng
    Li, Haifeng
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 4916 - 4930
  • [27] Object-Centric Masked Image Modeling-Based Self-Supervised Pretraining for Remote Sensing Object Detection
    Zhang, Tong
    Zhuang, Yin
    Chen, He
    Chen, Liang
    Wang, Guanqun
    Gao, Peng
    Dong, Hao
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 5013 - 5025
  • [28] Self-Supervised Learning for High-Resolution Remote Sensing Images Change Detection With Variational Information Bottleneck
    Wang, Congcong
    Du, Shouhang
    Sun, Wenbin
    Fan, Deqin
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 5849 - 5866
  • [29] Interactive and Supervised Dual-Mode Attention Network for Remote Sensing Image Change Detection
    Ren, Hongjin
    Xia, Min
    Weng, Liguo
    Lin, Haifeng
    Huang, Junqing
    Hu, Kai
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [30] Self-Supervised GANs With Similarity Loss for Remote Sensing Image Scene Classification
    Guo, Dongen
    Xia, Ying
    Luo, Xiaobo
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 (14) : 2508 - 2521