Contrastive Learning Based on Transformer for Hyperspectral Image Classification

被引:45
作者
Hu, Xiang [1 ]
Li, Teng [2 ,3 ]
Zhou, Tong [1 ,2 ]
Liu, Yu [3 ]
Peng, Yuanxi [1 ]
机构
[1] Natl Univ Def Technol, Coll Comp, State Key Lab High Performance Comp, Changsha 410073, Peoples R China
[2] Natl Univ Def Technol, Beijing Inst Adv Study, Beijing 100020, Peoples R China
[3] Natl Univ Def Technol, Coll Adv Interdisciplinary Studies, Changsha 410073, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2021年 / 11卷 / 18期
基金
中国国家自然科学基金;
关键词
deep learning; transformer; unsupervised hyperspectral image classification; contrastive learning;
D O I
10.3390/app11188670
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Recently, deep learning has achieved breakthroughs in hyperspectral image (HSI) classification. Deep-learning-based classifiers require a large number of labeled samples for training to provide excellent performance. However, the availability of labeled data is limited due to the significant human resources and time costs of labeling hyperspectral data. Unsupervised learning for hyperspectral image classification has thus received increasing attention. In this paper, we propose a novel unsupervised framework based on a contrastive learning method and a transformer model for hyperspectral image classification. The experimental results prove that our model can efficiently extract hyperspectral image features in unsupervised situations.
引用
收藏
页数:13
相关论文
共 28 条
[1]  
Ballard D. H., 1987, AAAI, P279
[2]  
Cao Z., 2020, ARXIV200900953
[3]  
Chen T, 2020, PR MACH LEARN RES, V119
[4]   Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks [J].
Chen, Yushi ;
Jiang, Hanlu ;
Li, Chunyang ;
Jia, Xiuping ;
Ghamisi, Pedram .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (10) :6232-6251
[5]  
Dehghani M., 2021, 9 INT C LEARN REPR I, DOI DOI 10.48550/ARXIV.2010.11929
[6]   Modified Fisher's linear discriminant analysis for hyperspectral imagery [J].
Du, Qian .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2007, 4 (04) :503-507
[7]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[8]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[9]  
Grill Jean-Bastien, 2020, NeurIPS
[10]   Momentum Contrast for Unsupervised Visual Representation Learning [J].
He, Kaiming ;
Fan, Haoqi ;
Wu, Yuxin ;
Xie, Saining ;
Girshick, Ross .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :9726-9735