Unsupervised semantic segmentation of radar sounder data using contrastive learning

被引:4
作者
Donini, Elena [1 ]
Amico, Mattia [2 ]
Bruzzone, Lorenzo [2 ]
Bovolo, Francesca [1 ]
机构
[1] Fdn Bruno Kessler, Ctr Digital Soc, Via Sommarive 18, I-38123 Trento, Italy
[2] Univ Trento, Dept Informat Engn & Comp Sci, Sommarive 5, I-38123 Trento, Italy
来源
IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING XXVIII | 2022年 / 12267卷
关键词
Unsupervised semantic segmentation; Contrastive learning; Image processing; Radar sounder; Subsurface sensing;
D O I
10.1117/12.2636437
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Radar Sounders (RSs) are active sensors widely used for planetary exploration and Earth observation that probe the subsurface in a non-intrusive way by acquiring vertical profiles, called radargrams. Radargrams contain information on subsurface geology and are analyzed with neural networks for segmentation and target detection. However, most of these methods rely on supervised training, which requires a large amount of labeled data that is hard to retrieve. Hence, a need emerges for a novel method for unsupervised radargram segmentation. This paper proposes a novel method for unsupervised radargram segmentation by analyzing semantically meaningful features extracted from a deep network trained with a contrastive logic. First, the network (encoder) is trained using a pretext task to extract meaningful features (query). Considering a dictionary of possible features (keys), the encoder training loss can be defined as a dictionary look-up problem. Each query is matched to a key in a large and consistent dictionary. Although such a dictionary is not available for RS data, it is dynamically computed by extracting meaningful features with another deep network called the momentum encoder. Secondly, deep feature vectors are extracted from the encoder for all radargram pixels. After the feature selection, the feature vectors are binarized. Since pixels of the same class are expected to have similar feature vectors, we compute the similarity between the feature vectors to generate a cluster of pixels for each class. We applied the proposed method to segment radargrams acquired in Greenland by the MCoRDS-3 sensor, achieving good overall accuracy.
引用
收藏
页数:10
相关论文
共 29 条
  • [1] Bergamasco Luca, 2021, 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, P3337, DOI 10.1109/IGARSS47720.2021.9553859
  • [2] Bruzzone Lorenzo, 2021, 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, P661, DOI 10.1109/IGARSS47720.2021.9553877
  • [3] Bruzzone L, 2015, INT GEOSCI REMOTE SE, P1257, DOI 10.1109/IGARSS.2015.7326002
  • [4] ENVISION MISSION TO VENUS: SUBSURFACE RADAR SOUNDING
    Bruzzone, Lorenzo
    Bovolo, Francesca
    Thakur, Sanchari
    Carrer, Leonardo
    Donini, Elena
    Gerekos, Christopher
    Paterna, Stefano
    Santoni, Massimo
    Sbalchiero, Elisa
    [J]. IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 5960 - 5963
  • [5] Knowledge-guided Deep Reinforcement Learning for Interactive Recommendation
    Chen, Xiaocong
    Huang, Chaoran
    Yao, Lina
    Wang, Xianzhi
    Liu, Wei
    Zhang, Wenjie
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [6] Donini Elena, 2021, 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, P2955, DOI 10.1109/IGARSS47720.2021.9554785
  • [7] Donini E., 2021, IEEE T GEOSCI ELECT, V60, P1
  • [8] An Unsupervised Fuzzy System for the Automatic Detection of Candidate Lava Tubes in Radar Sounder Data
    Donini, Elena
    Carrer, Leonardo
    Gerekos, Christopher
    Bruzzone, Lorenzo
    Bovolo, Francesca
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [9] An automatic approach to map refreezing ice in radar sounder data
    Donini, Elena
    Thakur, Sanchari
    Bovolo, Francesca
    Bruzzone, Lorenzo
    [J]. IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING XXV, 2019, 11155
  • [10] Dosovitskiy A, 2014, ADV NEUR IN, V27