Adaptive Spatial Pyramid Constraint for Hyperspectral Image Classification With Limited Training Samples

被引:23
作者
Yue, Jun [1 ]
Zhu, Dingshun [2 ]
Fang, Leyuan [2 ,3 ]
Ghamisi, Pedram [4 ,5 ]
Wang, Yaowei [3 ]
机构
[1] Changsha Univ Sci & Technol, Dept Geomat Engn, Changsha 410114, Peoples R China
[2] Hunan Univ, Coll Elect & Informat Engn, Changsha 410082, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518000, Peoples R China
[4] Helmholtz Zentrum Dresden Rossendorf HZDR, Helmholtz Inst Freiberg Resource Technol, D-09599 Freiberg, Germany
[5] Inst Adv Res Artificial Intelligence IARAI, A-1030 Vienna, Austria
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2022年 / 60卷
关键词
Complexity theory; Image edge detection; Feature extraction; Image segmentation; Training; Deep learning; Correlation; Deep neural network; hyperspectral image (HSI) classification; image complexity; over segmentation; spatial pyramid constraint; DIMENSIONALITY REDUCTION; NETWORK; COMPONENTS; FRAMEWORK; PROFILES;
D O I
10.1109/TGRS.2021.3095056
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Deep learning-based methods have made significant progress in hyperspectral image (HSI) classification in recent years. However, deep learning-based methods usually rely on a large number of samples, and in many cases, it is difficult to label HSI and only limited training samples are available. To solve this problem, an HSI classification method based on adaptive spatial pyramid constraint (ASPC) is proposed to make full use of the global spatial neighborhood information of the labeled samples, which can improve the generalization ability of the classification model. The main steps of the proposed method are as follows. First, an HSI complexity evaluation method based on edge detection is proposed to assess the homogeneity of the objects in the HSI. Second, an HSI pyramid segmentation method based on spatial pyramid is proposed to generate multiscale subregions, where HSI complexity is used to adaptively determine the scale of the segmentation. Third, a spatial supervised constraint is proposed to generate the loss function of labeled subregions. Fourth, a spatial unsupervised constraint is proposed to generate the loss function of unlabeled subregions. The proposed method fully explores the spatial-spectral correlation between unlabeled samples and labeled samples, and add corresponding constraints to the training objective according to the correlation. By adding the ASPC, the trained model becomes more robust and can make full use of the limited training samples. To verify the effectiveness of the proposed method, three benchmark hyperspectral datasets are used to verify the performance of the proposed method. Experimental results show that the performance of this method is better than the existing state-of-the-art methods.
引用
收藏
页数:14
相关论文
共 77 条
  • [1] Semisupervised Hyperspectral Image Classification Using Small Sample Sizes
    Aydemir, Muhammet Said
    Bilgin, Gokhan
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (05) : 621 - 625
  • [2] Improved manifold coordinate representations of large-scale hyperspectral scenes
    Bachmann, Charles M.
    Ainsworth, Thomas L.
    Fusina, Robert A.
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2006, 44 (10): : 2786 - 2803
  • [3] Benediktsson JA, 2015, ARTECH HSE REMOTE SE, P1
  • [4] Learning Deep Architectures for AI
    Bengio, Yoshua
    [J]. FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2009, 2 (01): : 1 - 127
  • [5] One-Shot Video Object Segmentation
    Caelles, S.
    Maninis, K. -K.
    Pont-Tuset, J.
    Leal-Taixe, L.
    Cremers, D.
    Van Gool, L.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5320 - 5329
  • [6] DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
    Chen, Liang-Chieh
    Papandreou, George
    Kokkinos, Iasonas
    Murphy, Kevin
    Yuille, Alan L.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) : 834 - 848
  • [7] Chen Y. W., 2008, CLASSIFICATION HIGHR
  • [8] Spectral-Spatial Classification of Hyperspectral Data Based on Deep Belief Network
    Chen, Yushi
    Zhao, Xing
    Jia, Xiuping
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2015, 8 (06) : 2381 - 2392
  • [9] Deep Learning-Based Classification of Hyperspectral Data
    Chen, Yushi
    Lin, Zhouhan
    Zhao, Xing
    Wang, Gang
    Gu, Yanfeng
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2014, 7 (06) : 2094 - 2107
  • [10] Dinh L., 2014, ARXIV PREPRINT ARXIV