Purified Contrastive Learning With Global and Local Representation for Hyperspectral Image Classification

被引:1
作者
Zhao, Lin [1 ]
Li, Jia [1 ]
Luo, Wenqiang [1 ]
Ouyang, Er [2 ]
Wu, Jianhui [1 ]
Zhang, Guoyun [1 ]
Li, Wujin [1 ]
机构
[1] Hunan Inst Sci & Technol, Hunan Engn Technol Res Ctr 3D Reconstruct & Intell, Yueyang 414000, Peoples R China
[2] Shenzhen Univ, Shenzhen 518060, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
关键词
Feature extraction; Convolutional neural networks; Transformers; Convolution; Data mining; Task analysis; Computer architecture; Contrastive learning; convolutional neural network (CNN); hyperspectral image (HSI) classification; vision Transformer; NETWORK;
D O I
10.1109/TGRS.2024.3409378
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Contrastive learning has emerged as a promising technique for hyperspectral image (HSI) classification. However, the inherent limitation of sliding window sampling in HSI results in partial samples within a mini-batch exhibiting extremely high similarity. Consequently, there is an increased number of negative sample pairs composed of similar samples, significantly reducing the effectiveness of contrastive learning. Moreover, prevailing classification models heavily depends on convolutional operations, emphasizing the extraction of local features but struggle to capture long-distance dependencies in both spatial and spectral dimensions. To address these problems and fully leverage the abundance of unlabeled samples, we propose a novel purified contrastive learning (PCL) framework for HSI classification. We design a complementary spatial-spectral representation encoder architecture that combines convolutional neural network (CNN) and Transformer to capture local features and global dependencies. More importantly, a purified contrastive loss function is proposed based on super-pixel spatial prior. Extensive experiments on three public datasets demonstrate the superiority of PCL over state-of-the-art methods in HSI classification. The code for this work is available at https://github.com/zhaolin6/PCL for the sake of reproducibility.
引用
收藏
页数:14
相关论文
共 55 条
  • [1] SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
    Achanta, Radhakrishna
    Shaji, Appu
    Smith, Kevin
    Lucchi, Aurelien
    Fua, Pascal
    Suesstrunk, Sabine
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) : 2274 - 2281
  • [2] Transformer-Based Masked Autoencoder With Contrastive Loss for Hyperspectral Image Classification
    Cao, Xianghai
    Lin, Haifeng
    Guo, Shuaixu
    Xiong, Tao
    Jiao, Licheng
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [3] Chen T, 2020, PR MACH LEARN RES, V119
  • [4] Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks
    Chen, Yushi
    Jiang, Hanlu
    Li, Chunyang
    Jia, Xiuping
    Ghamisi, Pedram
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (10): : 6232 - 6251
  • [5] SpectralFormer: Rethinking Hyperspectral Image Classification With Transformers
    Hong, Danfeng
    Han, Zhu
    Yao, Jing
    Gao, Lianru
    Zhang, Bing
    Plaza, Antonio
    Chanussot, Jocelyn
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [6] Dosovitskiy A., 2021, IMAGE IS WORTH 16 16, DOI DOI 10.48550/ARXIV.2010.11929
  • [7] A Multiscale Dual-Branch Feature Fusion and Attention Network for Hyperspectral Images Classification
    Gao, Hongmin
    Zhang, Yiyan
    Chen, Zhonghao
    Li, Chenming
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 8180 - 8192
  • [8] Grill J.-B., 2006, ARXIV
  • [9] Cross-Modality Contrastive Learning for Hyperspectral Image Classification
    Hang, Renlong
    Qian, Xuwei
    Liu, Qingshan
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [10] Hyperspectral Image Classification With Attention-Aided CNNs
    Hang, Renlong
    Li, Zhu
    Liu, Qingshan
    Ghamisi, Pedram
    Bhattacharyya, Shuvra S.
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (03): : 2281 - 2293