PICS: Paradigms Integration and Contrastive Selection for Semisupervised Remote Sensing Images Semantic Segmentation

被引:9
|
作者
Qi, Xiyu [1 ,2 ,3 ,4 ]
Mao, Yongqiang [1 ,2 ,3 ,4 ]
Zhang, Yidan [1 ,2 ,3 ,4 ]
Deng, Yawen [1 ,2 ]
Wei, Haoran [1 ,2 ,3 ,4 ]
Wang, Lei [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100190, Peoples R China
[2] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Network Informat Syst Technol NIST, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100190, Peoples R China
[4] Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing 100190, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
关键词
Remote sensing; Training; Semantic segmentation; Semisupervised learning; Data models; Predictive models; Visualization; Paradigms integration; remote sensing; selective self-training; semantic segmentation; semisupervised learning (SSL); RESOLUTION; CLASSIFICATION; NETWORK;
D O I
10.1109/TGRS.2023.3239042
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Remote sensing images semantic segmentation is a fundamental yet challenging task, which has long relied heavily on sufficient pixelwise annotations. Semisupervised learning is proposed to address the problem of high dependence on labeled data by exploiting more learnable samples generated from the large amounts of accessible unlabeled data. However, affected by the complexity and diversity of remote sensing images, various misclassifications often occur and lead to errors accumulation during model training. Errors accumulation will destroy the consistency of model training and lead to degradation of final segmentation performance. In this article, in order to further alleviate the damage caused by the errors to the consistency of model training and improve final segmentation accuracy, we propose a novel semisupervised segmentation framework, paradigms integration and contrastive selection (PICS). First, multiple proven semisupervised paradigms are integrated to generate pseudolabeled samples with less noise. Second, a loss-based contrastive selection method is explored to distinguish generated samples that contain different degrees of inevitable misclassification, thereby further maintaining the approximation of the generated samples and the ground truth in the sample space. By generating and selecting high-quality pseudolabeled samples for selective self-training, we can better guarantee consistency during model training and obtain better segmentation results. Extensive experiments over the ISPRS Vaihingen, Potsdam, and the challenging iSAID benchmarks demonstrate that our method yields significant accuracy boosting on the segmentation results and achieves on-par performance with the state of the arts.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Label Propagation and Contrastive Regularization for Semisupervised Semantic Segmentation of Remote Sensing Images
    Yang, Zhujun
    Yan, Zhiyuan
    Diao, Wenhui
    Zhang, Qiang
    Kang, Yuzhuo
    Li, Junxi
    Li, Xinming
    Sun, Xian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [2] Semisupervised Semantic Segmentation of Remote Sensing Images With Consistency Self-Training
    Li, Jiahao
    Sun, Bin
    Li, Shutao
    Kang, Xudong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [3] SegMind: Semisupervised Remote Sensing Image Semantic Segmentation With Masked Image Modeling and Contrastive Learning Method
    Li, Zhenghong
    Chen, Hao
    Wu, Jiangjiang
    Li, Jun
    Jing, Ning
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [4] Semi-Supervised Semantic Segmentation of Remote Sensing Images With Iterative Contrastive Network
    Wang, Jia-Xin
    Chen, Si-Bao
    Ding, Chris H. Q.
    Tang, Jin
    Luo, Bin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [5] Hidden Path Selection Network for Semantic Segmentation of Remote Sensing Images
    Yang, Kunping
    Tong, Xin-Yi
    Xia, Gui-Song
    Shen, Weiming
    Zhang, Liangpei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [6] Spatial and Semantic Consistency Contrastive Learning for Self-Supervised Semantic Segmentation of Remote Sensing Images
    Dong, Zhe
    Liu, Tianzhu
    Gu, Yanfeng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [7] Spatial and Semantic Consistency Contrastive Learning for Self-Supervised Semantic Segmentation of Remote Sensing Images
    Dong, Zhe
    Liu, Tianzhu
    Gu, Yanfeng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [8] Semantic Segmentation for Remote Sensing Images Based on Adaptive Feature Selection Network
    Xiang, Shao
    Xie, Quangqi
    Wang, Mi
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [9] A New Semisupervised Method for Detecting Semantic Changes in Remote Sensing Images
    Zou, Changzhong
    Wang, Ziyuan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [10] AdaptMatch: Adaptive Matching for Semisupervised Binary Segmentation of Remote Sensing Images
    Huang, Wei
    Shi, Yilei
    Xiong, Zhitong
    Zhu, Xiao Xiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61 : 1 - 16