CutMix-CD: Advancing Semi-Supervised Change Detection via Mixed Sample Consistency

被引:2
作者
Shu, Qidi [1 ]
Zhu, Xiaolin [1 ,2 ]
Wan, Luoma [1 ]
Zhao, Shuheng [1 ]
Liu, Denghong [1 ]
Peng, Longkang [1 ]
Chen, Xiaobei [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Land Surveying & Geoinformat, Hong Kong, Peoples R China
[2] Hong Kong Polytech Univ, Shenzhen Technol & Innovat Res Inst Futian, Shenzhen 518000, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2025年 / 63卷
关键词
Feature extraction; Training; Overfitting; Perturbation methods; Semisupervised learning; Decoding; Predictive models; Deep learning; Data models; Costs; Change detection (CD); consistency learning; deep learning; semi-supervised learning; NETWORK;
D O I
10.1109/TGRS.2024.3520630
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Change detection (CD) is an important task in Earth observation. In the past few years, significant progress has been made in supervised CD research; however, change labels are extremely expensive. The semi-supervised CD has attracted increasing attention. In semi-supervised CD, the problem of scarcity of positive samples is magnified. The imbalance of change types (e.g., disappearance and appearance), moreover, exacerbates the missing detection phenomenon. To address the above problems, we propose a semi-supervised CD method: CutMix-CD, which incorporates the change-aware CutMix augmentation into the consistency framework of CD. The semi-supervised learning framework enriches change contexts and places special emphasis on the comparative process, facilitating more robust representations of changes with improved generalization capabilities. First, mixed samples are synthesized using the change-aware CutMix operation. Then, we developed a student path and a teacher path to predict the changes in the original samples and mixed samples, respectively. Finally, the consistency loss is conducted between the two predictions to help the model learn the change information of unlabeled samples. In addition, an unsupervised feature constraint loss is proposed to further optimize the change features. Experiments on four datasets validate the effectiveness of CutMix-CD. It can effectively alleviate the overfitting problem for unbalanced types of changes and even outperforms the fully supervised methods for some challenging samples. The code will be released in https://github.com/SQD1/CutMixCD.
引用
收藏
页数:15
相关论文
共 51 条
[1]   Adversarial Instance Augmentation for Building Change Detection in Remote Sensing Images [J].
Chen, Hao ;
Li, Wenyuan ;
Shi, Zhenwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[2]   Remote Sensing Image Change Detection With Transformers [J].
Chen, Hao ;
Qi, Zipeng ;
Shi, Zhenwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[3]   A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection [J].
Chen, Hao ;
Shi, Zhenwei .
REMOTE SENSING, 2020, 12 (10)
[4]  
Chen HRX, 2024, Arxiv, DOI arXiv:2404.03425
[5]   Exchange means change: An unsupervised single-temporal change detection framework based on intra- and inter-image patch exchange [J].
Chen, Hongruixuan ;
Song, Jian ;
Wu, Chen ;
Du, Bo ;
Yokoya, Naoto .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 206 :87-105
[6]   Semi-supervised semantic segmentation framework with pseudo supervisions for land-use/land-cover mapping in coastal areas [J].
Chen, Jifa ;
Sun, Buyang ;
Wang, Lizhe ;
Fang, Bo ;
Chang, Yali ;
Li, Yukun ;
Zhang, Junpeng ;
Lyu, Xianlin ;
Chen, Gang .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 112
[7]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[8]  
French G, 2020, Arxiv, DOI arXiv:1906.01916
[9]  
Bandara WGC, 2022, Arxiv, DOI [arXiv:2204.08454, DOI 10.48550/ARXIV.2204.08454]
[10]   SAAN: Similarity-Aware Attention Flow Network for Change Detection With VHR Remote Sensing Images [J].
Guo, Haonan ;
Su, Xin ;
Wu, Chen ;
Du, Bo ;
Zhang, Liangpei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 :2599-2613