Inter-spectral contrast learning based unsupervised feature extraction for hyperspectral images

被引:0
作者
Hang R. [1 ,2 ]
Li C. [1 ,2 ]
Liu Q. [1 ,2 ]
机构
[1] School of Computer, Nanjing University of Information Science and Technology, Nanjing
[2] Jiangsu Collaborative Innovation Center of Atmospheric Environment and Equipment Technology, Nanjing
来源
Cehui Xuebao/Acta Geodaetica et Cartographica Sinica | 2023年 / 52卷 / 07期
基金
中国国家自然科学基金;
关键词
deep learning; feature extraction; hyperspectral image; unsupervised learning;
D O I
10.11947/J.AGCS.2023.20220493
中图分类号
学科分类号
摘要
Deep learning is able to extract high-level features from input data via layer by layer abstraction. In recent years, it has been widely used in hyperspectral image classitication. Most of the existing deep learning-based feature extraction methods for hyperspectral images belong to supervised learning models, which require a large number of labeled samples in the training process, but it is difficult and time-consuming to label hyperspectral images pixel by pixel. Therefore, we propose an unsupervised deep learning model based on inter-spectra I contrast learning in this paper. It can extract features by modeling the relationship between different spectral bands without annotation of samples. Specifically, because different spectral channels of hyperspectral image depict the response degree of the same object in different electromagnetic spectrum, there must be a feature space, which makes the spectral information of different channels have similar characterization. Inspired by this, we first divide the high-dimensional spectral information into two groups, and then extract the features of each group using multi-layer convolution operations. Finally, the features extracted from different samples are compared and a contrastive loss function is constructed to optimize the model parameters. To test the performance of the proposed model, it was applied to a hyperspectral image classification task and validated on three commonly used data sets, including Houston 2013, Pavia University and WHU-Hi-Longkou. Experimental results show that using only 10 training samples in each class, the proposed unsupervised learning model can obtain better classification performance than the commonly used unsupervised models such as principal component analysis and auto-encoder. © 2023 Shanghai Jiaotong University. All rights reserved.
引用
收藏
页码:1164 / 1174
页数:10
相关论文
共 27 条
[1]  
CHEN Yushi, LIN Zhouhan, ZHAO Xing, Et al., Deep learning-based elassifieation of hyperspectral data, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 7, 6, pp. 2094-2107, (2014)
[2]  
RASTI B, HONG Danfeng, HANG Renlong, Et al., Feature extraction for hyperspectral imagery: the evolution from shallow to deep: overview and toolbox[j], IEEE Ge-oscience and Remote Sensing Magazine, 8, 4, pp. 60-88, (2020)
[3]  
ZHANG Haokui, LI Ying, JIANG Yenan, Deep learning for hyperspectral imagery classification
[4]  
the state of the art and prospects[J], Acta Automatica Sinica, 44, 6, pp. 961-977, (2018)
[5]  
LI Yunfei, LI Jun, HE Lin, Convolutional neural network based single image pair method for spatiotemporal fusion, National Remote Sensing Bulletin, 26, 8, pp. 1614-1623, (2022)
[6]  
YANG Xing, CHI Yue, ZHOU Yatong, Et al., Spectralspatial attention bilateral network for hyperspectral image classification[J/OL], Journal of Remote Sensing, (2021)
[7]  
ZHAO Wudi, LI Shanshan, LI An, Et al., Deep fusion of hyperspectral images and multi-source remote sensing data for classification with convolutional neural network [J], National Remote Sensing Bulletin, 25, 7, pp. 1489-1502, (2021)
[8]  
WEI Xiangpo, YU Xuchu, ZHANG Pengqiang, Et al., CNN with local binary patterns for hyperspectral images classification, Journal of Remote Sensing, 24, 8, pp. 1000-1009, (2020)
[9]  
HANG Reniong, LIU Qingshan, HONG Danfeng, Et al., Cascaded recurrent neural networks for hyperspectral image classification, IEEE Transactions on Geoscience and Remote Sensing, 57, 8, pp. 5384-5394, (2019)
[10]  
ZHOU Feng, HANG Reniong, LIU Qingshan, Et al., Hyperspectral image classification using spectral-spatial LST-Ms, Neurocomputing, 328, 7, pp. 39-47, (2019)