Self-Supervised Change Detection in Multiview Remote Sensing Images

被引:53
作者
Chen, Yuxing [1 ]
Bruzzone, Lorenzo [1 ]
机构
[1] Univ Trento, Dept Informat Engn & Comp Sci, I-38122 Trento, Italy
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2022年 / 60卷
关键词
Change detection; multiview; remote sensing; self-supervised learning; sentinel-1/-2; UNSUPERVISED CHANGE DETECTION; CHANGE VECTOR ANALYSIS; SLOW FEATURE ANALYSIS; FRAMEWORK;
D O I
10.1109/TGRS.2021.3089453
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The large amount of unlabeled remote sensing acquired from different sources and at different times (defined as multiple views in this article) presents both an opportunity and a challenge for change detection. Recently, many generative model-based methods have been proposed for remote sensing image change detection on such unlabeled data. However, the high diversities in the learned features weaken the discrimination of the relevant change indicators in unsupervised change detection tasks. Moreover, these methods lack research on massive archived images. In this work, a self-supervised change detection approach based on an unlabeled multiview setting is proposed to overcome this limitation. This is achieved by the use of a multiview contrastive loss in the feature alignment between multiview images. In this approach, a pseudo-Siamese network is trained to regress the output between its two branches pretrained in a contrastive way on a large dataset of single-sensor or cross-sensor image pairs. Finally, the feature distance between the outputs of the two branches is used to define a change measure, which can be analyzed by thresholding to get the final binary change map. Experiments are carried out on two single-sensor and three crass-sensor datasets. The proposed approach is compared with other supervised and unsupervised state-of-the-art change detection methods. Results demonstrate both improvements over state-of-the-art unsupervised methods and the proposed approach narrows the gap between unsupervised and supervised change detection.
引用
收藏
页数:12
相关论文
共 48 条
  • [1] Change Detection in Optical Aerial Images by a Multilayer Conditional Mixed Markov Model
    Benedek, Csaba
    Sziranyi, Tamas
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2009, 47 (10): : 3416 - 3430
  • [2] A theoretical framework for unsupervised change detection based on change vector analysis in the polar domain
    Bovolo, Francesca
    Bruzzone, Lorenzo
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2007, 45 (01): : 218 - 236
  • [3] A Multilevel Parcel-Based Approach to Change Detection in Very High Resolution Multitemporal Images
    Bovolo, Francesca
    [J]. IEEE Geoscience and Remote Sensing Letters, 2009, 6 (01) : 33 - 37
  • [4] Bromley J., 1993, International Journal of Pattern Recognition and Artificial Intelligence, V7, P669, DOI 10.1142/S0218001493000339
  • [5] Automatic analysis of the difference image for unsupervised change detection
    Bruzzone, L
    Prieto, DF
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2000, 38 (03): : 1171 - 1182
  • [6] Detection of changes in remotely-sensed images by the selective use of multi-spectral information
    Bruzzone, L
    Serpico, SB
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 1997, 18 (18) : 3883 - 3888
  • [7] A Novel Framework for the Design of Change-Detection Systems for Very-High-Resolution Remote Sensing Images
    Bruzzone, Lorenzo
    Bovolo, Francesca
    [J]. PROCEEDINGS OF THE IEEE, 2013, 101 (03) : 609 - 630
  • [8] A new change-detection method in high-resolution remote sensing images based on a conditional random field model
    Cao, Guo
    Zhou, Licun
    Li, Yupeng
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2016, 37 (05) : 1173 - 1189
  • [9] Object-based change detection
    Chen, Gang
    Hay, Geoffrey J.
    Carvalho, Luis M. T.
    Wulder, Michael A.
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2012, 33 (14) : 4434 - 4457
  • [10] Multitask learning for large-scale semantic change detection
    Daudt, Rodrigo Caye
    Le Saux, Bertrand
    Boulch, Alexandre
    Gousseau, Yann
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 187