Semisupervised Change Detection With Feature-Prediction Alignment

被引:24
作者
Zhang, Xueting [1 ]
Huang, Xin [2 ,3 ,4 ]
Li, Jiayi [2 ,4 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Infornat Engn, Wuhan 430079, Peoples R China
[2] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[3] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430079, Peoples R China
[4] Hubei Luojia Lab, Wuhan 430079, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
基金
中国国家自然科学基金;
关键词
Feature extraction; Training; Optimization; Entropy; Convolutional neural networks; Annotations; Uncertainty; Change detection (CD); feature-prediction alignment (FPA); remote sensing; semisupervised learning (SSL); NETWORKS;
D O I
10.1109/TGRS.2023.3247605
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Change detection (CD) has received raising attention for its broad application value. However, traditional fully supervised CD methods have a huge demand for pixel-level annotations, which are laborious and even impossible in some few-shot scenarios. Recently, several semisupervised CD (SSCD) methods have been proposed to utilize numerous unlabeled remote sensing image (RSI) pairs, which can largely reduce the annotation dependence. These methods are mainly based on: 1) adversarial learning, whose optimization direction is difficult to control as a black-box method, or 2) feature-consistency learning, which has no explicit physical meaning. To deal with these difficulties, we propose a novel progressive SSCD framework in this article, termed feature-prediction alignment (FPA). FPA can efficiently utilize unlabeled RSI pairs for training by two alignment strategies. First, a class-aware feature alignment (FA) strategy is designed to align the area-level change/no-change feature extracted from different unlabeled RSI pairs (i.e., across regions) with the awareness of their locations, in order to reduce the feature difference within the same classes. Second, a pixelwise prediction alignment (PA) is devised to align the pixel-level change prediction of strongly augmented unlabeled RSI pairs to the pseudo-labels calculated from the corresponding weakly augmented counterparts, in order to reduce the prediction uncertainty of various RSI transformations with physical meaning. Experiments are carried out on four widely used CD benchmarks, including Learning, Vision and Remote Sensing Laboratory (LEVIR-CD), Wuhan University building CD (WHU-CD), CDD, and GZ-CD, and our FPA achieves the state-of-the-art performance. The experimental results demonstrate the superiority of our method in both effectiveness and generalization. Our code is available at https://github.com/zxt9/FPA-SSCD.
引用
收藏
页数:16
相关论文
共 59 条
  • [1] UCDNet: A Deep Learning Model for Urban Change Detection From Bi-Temporal Multispectral Sentinel-2 Satellite Images
    Basavaraju, K. S.
    Sravya, N.
    Lal, Shyam
    Nalini, J.
    Reddy, Chintala Sudhakar
    Dell'Acqua, Fabio
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [2] Gaussian Process Approach to Remote Sensing Image Classification
    Bazi, Yakoub
    Melgani, Farid
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2010, 48 (01): : 186 - 197
  • [3] Bennett KP, 1999, ADV NEUR IN, V11, P368
  • [4] Blum A., 2001, P 18 INT C MACHINE L, P19, DOI [10.1184/R1/6606860.V1, DOI 10.1184/R1/6606860.V1]
  • [5] Bovolo F, 2005, LECT NOTES COMPUT SC, V3776, P260
  • [6] A novel approach to unsupervised change detection based on a semisupervised SVM and a similarity measure
    Bovolo, Francesca
    Bruzzone, Lorenzo
    Marconcini, Mattia
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2008, 46 (07): : 2070 - 2082
  • [7] Bromley J., 1993, International Journal of Pattern Recognition and Artificial Intelligence, V7, P669, DOI 10.1142/S0218001493000339
  • [8] Chen DD, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P2014
  • [9] Chen H., 2022, ARXIV
  • [10] A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection
    Chen, Hao
    Shi, Zhenwei
    [J]. REMOTE SENSING, 2020, 12 (10)