Semi-Active Convolutional Neural Networks for Hyperspectral Image Classification

被引:50
|
作者
Yao, Jing [1 ]
Cao, Xiangyong [2 ,3 ]
Hong, Danfeng [1 ]
Wu, Xin [4 ]
Meng, Deyu [5 ,6 ]
Chanussot, Jocelyn [7 ,8 ]
Xu, Zongben [5 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Comp Sci & Technol, Xian 710049, Peoples R China
[3] Minist Educ, Key Lab Intelligent Networks & Network Secur, Xian 710049, Peoples R China
[4] Beijing Univ Posts & Telecommun, Sch Comp Sci, Natl Pilot Software Engn Sch, Beijing 100876, Peoples R China
[5] Xi An Jiao Tong Univ, Sch Math & Stat, Xian 710049, Peoples R China
[6] Macau Univ Sci & Technol, Macau Inst Syst Engn, Taipa, Macao, Peoples R China
[7] Univ Grenoble Alpes, GIPSA Lab, CNRS, Grenoble INP, F-38000 Grenoble, France
[8] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
基金
中国国家自然科学基金;
关键词
Training; Feature extraction; Schedules; Convolutional neural networks; Iterative methods; Image segmentation; Hyperspectral imaging; Active learning; classification; convolutional neural network (CNN); deep learning (DL); hyperspectral; pseudolabel; remote sensing; semi-supervised learning; superpixel segmentation; MANIFOLD ALIGNMENT; REGRESSION; FRAMEWORK; LABELS; JOINT;
D O I
10.1109/TGRS.2022.3206208
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Owing to the powerful data representation ability of deep learning (DL) techniques, tremendous progress has been recently made in hyperspectral image (HSI) classification. Convolutional neural network (CNN), as a main part of the DL family, has been proven to be considerably effective to extract spatial-spectral features for HSIs. Nevertheless, its classification performance, to a great extent, depends on the quality and quantity of samples in the network training process. To select those samples, either labeled or unlabeled, which can be used to enhance the generalization ability of CNNs and further improve the classification accuracy, we propose an iterative semi-supervised CNNs framework by means of active learning and superpixel segmentation techniques, dubbed as semi-active CNNs (SA-CNNs), for HSI classification. More specifically, we start to pretrain a CNN-based model on a small-scale unbiased labeled set and infer unlabeled data using the trained model, i.e., generating pseudolabels. Then, the reliable samples, which consist of two parts: high label homogeneity and most informativeness, are actively selected from superpixel segments. These selected labeled and unlabeled samples with their labels and pseudolabels are refed into the next-round network training. Moreover, three different schedules, i.e., log-, exp-, and linear-schedules, are progressively adopted to fully explore their potentials in sample selection, until a labeling budget is finally reached. Extensive experiments are conducted on three benchmark HSI datasets, demonstrating substantial performance improvements of the proposed SA-CNNs over other similar competitors.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Advances in Hyperspectral Image Classification Based on Convolutional Neural Networks: A Review
    Bera, Somenath
    Shrivastava, Vimal K.
    Satapathy, Suresh Chandra
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2022, 133 (02): : 219 - 250
  • [22] Advances in Hyperspectral Image Classification Based on Convolutional Neural Networks: A Review
    Bera, Somenath
    Shrivastava, Vimal K.
    Satapathy, Suresh Chandra
    CMES - Computer Modeling in Engineering and Sciences, 2022, 133 (02): : 219 - 250
  • [23] Graph Convolutional Networks for Hyperspectral Image Classification
    Hong, Danfeng
    Gao, Lianru
    Yao, Jing
    Zhang, Bing
    Plaza, Antonio
    Chanussot, Jocelyn
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (07): : 5966 - 5978
  • [24] Hyperspectral Image Classification Based on Convolutional Neural Networks With Adaptive Network Structure
    Ding, Chen
    Li, Wei
    Zhang, Lei
    Tian, Chunna
    Wei, Wei
    Zhang, Yanning
    2018 INTERNATIONAL CONFERENCE ON ORANGE TECHNOLOGIES (ICOT), 2018,
  • [25] Road excitation classification for semi-active suspension system with deep neural networks
    Qin, Yechen
    Langari, Reza
    Wang, Zhenfeng
    Xiang, Changle
    Dong, Mingming
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2017, 33 (03) : 1907 - 1918
  • [26] Hierarchical Multi-Scale Convolutional Neural Networks for Hyperspectral Image Classification
    Li, Simin
    Zhu, Xueyu
    Bao, Jie
    SENSORS, 2019, 19 (07)
  • [27] EXPLORING THE COLLABORATION BETWEEN CONVOLUTIONAL NEURAL NETWORKS AND TRANSFORMERS IN HYPERSPECTRAL IMAGE CLASSIFICATION
    Gao, Hongmin
    Zhang, Yiyan
    Chen, Zhonghao
    Wu, Hongyi
    Zhang, Weibo
    Li, Chenming
    2022 12TH WORKSHOP ON HYPERSPECTRAL IMAGING AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2022,
  • [28] Hyperspectral Image Classification Using Convolutional Neural Networks and Multiple Feature Learning
    Gao, Qishuo
    Lim, Samsung
    Jia, Xiuping
    REMOTE SENSING, 2018, 10 (02)
  • [29] Convolutional Neural Networks Based Hyperspectral Image Classification Method with Adaptive Kernels
    Ding, Chen
    Li, Ying
    Xia, Yong
    Wei, Wei
    Zhang, Lei
    Zhang, Yanning
    REMOTE SENSING, 2017, 9 (06)
  • [30] HYPERSPECTRAL IMAGE CLASSIFICATION USING SPECTRAL-SPATIAL CONVOLUTIONAL NEURAL NETWORKS
    Nalepa, Jakub
    Tulczyjew, Lukasz
    Myller, Michal
    Kawulok, Michal
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 866 - 869