Discriminative feature constraints via supervised contrastive learning for few-shot forest tree species classification using airborne hyperspectral images

被引:12
作者
Chen, Long [1 ,2 ]
Wu, Jing [1 ,2 ]
Xie, Yifan [1 ,2 ]
Chen, Erxue [3 ]
Zhang, Xiaoli [1 ,2 ]
机构
[1] Beijing Forestry Univ, Forestry Coll, Beijing Key Lab Precis Forestry, Beijing 100083, Peoples R China
[2] Beijing Forestry Univ, Key Lab Forest Cultivat & Protect, Minist Educ, Beijing 100083, Peoples R China
[3] Chinese Acad Forestry, Inst Forest Resource Informat Tech, Beijing 100091, Peoples R China
基金
中国国家自然科学基金;
关键词
Supervised contrastive learning; Multiple tree species classification; Prototypical networks; Airborne hyperspectral images; RandAugment; CLASSIFIERS; NETWORK;
D O I
10.1016/j.rse.2023.113710
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In scenarios where sample collection is limited, studying few-shot learning algorithms such as prototypical networks (P-Net) is a keynote topic for supervised multiple tree species classification. In a previous study, we improved the P-Net by combining the feature enhancement algorithm based on the convolutional block attention module and several popular data augmentation methods in the computer vision domain, the classification accuracy can be significantly increased, and the degree of model overfitting can be reduced. However, there is a clear boundary between the data augmentations and the feature enhancement algorithm, which is manifested in that data augmentations are only used to enrich the diversity of the learned samples, but cannot directly affect the construction of the objective function, thus limiting the ability of data augmentations. In fact, in the supervised contrastive learning research, data augmentation methods are often used to generate positive samples of an anchor image to construct the objective function, i.e. supervised contrastive loss. The core idea for solving such a boundary problem is to use contrastive learning to make the anchor image close to its positive samples and the negative samples away from each other. Inspired by this, we introduced supervised contrastive learning in the P-Net, i.e., SCL-P-Net, which takes the discriminative feature representations as the constraints of the prototype clustering algorithm. In SCL-P-Net, data augmentation methods can not only extend the sample distribution, but also be used to construct the supervised contrastive loss directly. The study involves four airborne hyperspectral image datasets related to tree species classification, including the GFF-A and GFF-B datasets collected from Gaofeng Forest Farm in Nanning City, Guangxi Province, South China, the Xiongan dataset from Matiwan Village in Xiongan New Area, Hebei Province, North China, and the Tea Farm dataset from Fanglu Tea Farm in Changzhou City, Jiangsu Province, East China. The highest overall accuracy (OA) for the four datasets is 99.23% for GFF-A, 98.39% for GFF-B, 99.30% for Xiongan, and 99.54% for Tea Farm. It is concluded that the proposed SCL-P-Net classification framework can achieve multiple tree species classification with high-precision. Without changing the basic classification framework of P-Net, the introduction of supervised contrastive learning makes the combination of the data augmentations and the feature enhancement algorithm and plays a positive role in improving the distinguishability between samples.
引用
收藏
页数:20
相关论文
共 53 条
  • [1] Acquarelli J., 2017, CONVOLUTIONAL NEURAL
  • [2] Bertinetto L, 2019, Arxiv, DOI arXiv:1805.08136
  • [3] ContrastNet: Unsupervised feature learning by autoencoder and prototypical contrastive learning for hyperspectral imagery classification
    Cao, Zeyu
    Li, Xiaorun
    Feng, Yueming
    Chen, Shuhan
    Xia, Chaoqun
    Zhao, Liaoying
    [J]. NEUROCOMPUTING, 2021, 460 : 71 - 83
  • [4] [岑奕 Cen Yi], 2020, [遥感学报, Journal of Remote Sensing], V24, P1299
  • [5] Chen J.-W, 2020, ARXIV
  • [6] Data Augmentation in Prototypical Networks for Forest Tree Species Classification Using Airborne Hyperspectral Images
    Chen, Long
    Wei, Yuxin
    Yao, Zongqi
    Chen, Erxue
    Zhang, Xiaoli
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [7] A New CBAM-P-Net Model for Few-Shot Forest Species Classification Using Airborne Hyperspectral Images
    Chen, Long
    Tian, Xiaomin
    Chai, Guoqi
    Zhang, Xiaoli
    Chen, Erxue
    [J]. REMOTE SENSING, 2021, 13 (07)
  • [8] Chen T, 2020, PR MACH LEARN RES, V119
  • [9] Randaugment: Practical automated data augmentation with a reduced search space
    Cubuk, Ekin D.
    Zoph, Barret
    Shlens, Jonathon
    Le, Quoc, V
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 3008 - 3017
  • [10] DeVries T, 2017, Arxiv, DOI [arXiv:1708.04552, DOI 10.48550/ARXIV.1708.04552]