Semi-Active Convolutional Neural Networks for Hyperspectral Image Classification

被引:51
|
作者
Yao, Jing [1 ]
Cao, Xiangyong [2 ,3 ]
Hong, Danfeng [1 ]
Wu, Xin [4 ]
Meng, Deyu [5 ,6 ]
Chanussot, Jocelyn [7 ,8 ]
Xu, Zongben [5 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Comp Sci & Technol, Xian 710049, Peoples R China
[3] Minist Educ, Key Lab Intelligent Networks & Network Secur, Xian 710049, Peoples R China
[4] Beijing Univ Posts & Telecommun, Sch Comp Sci, Natl Pilot Software Engn Sch, Beijing 100876, Peoples R China
[5] Xi An Jiao Tong Univ, Sch Math & Stat, Xian 710049, Peoples R China
[6] Macau Univ Sci & Technol, Macau Inst Syst Engn, Taipa, Macao, Peoples R China
[7] Univ Grenoble Alpes, GIPSA Lab, CNRS, Grenoble INP, F-38000 Grenoble, France
[8] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2022年 / 60卷
基金
中国国家自然科学基金;
关键词
Training; Feature extraction; Schedules; Convolutional neural networks; Iterative methods; Image segmentation; Hyperspectral imaging; Active learning; classification; convolutional neural network (CNN); deep learning (DL); hyperspectral; pseudolabel; remote sensing; semi-supervised learning; superpixel segmentation; MANIFOLD ALIGNMENT; REGRESSION; FRAMEWORK; LABELS; JOINT;
D O I
10.1109/TGRS.2022.3206208
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Owing to the powerful data representation ability of deep learning (DL) techniques, tremendous progress has been recently made in hyperspectral image (HSI) classification. Convolutional neural network (CNN), as a main part of the DL family, has been proven to be considerably effective to extract spatial-spectral features for HSIs. Nevertheless, its classification performance, to a great extent, depends on the quality and quantity of samples in the network training process. To select those samples, either labeled or unlabeled, which can be used to enhance the generalization ability of CNNs and further improve the classification accuracy, we propose an iterative semi-supervised CNNs framework by means of active learning and superpixel segmentation techniques, dubbed as semi-active CNNs (SA-CNNs), for HSI classification. More specifically, we start to pretrain a CNN-based model on a small-scale unbiased labeled set and infer unlabeled data using the trained model, i.e., generating pseudolabels. Then, the reliable samples, which consist of two parts: high label homogeneity and most informativeness, are actively selected from superpixel segments. These selected labeled and unlabeled samples with their labels and pseudolabels are refed into the next-round network training. Moreover, three different schedules, i.e., log-, exp-, and linear-schedules, are progressively adopted to fully explore their potentials in sample selection, until a labeling budget is finally reached. Extensive experiments are conducted on three benchmark HSI datasets, demonstrating substantial performance improvements of the proposed SA-CNNs over other similar competitors.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Hyperspectral Image Classification With Convolutional Neural Network and Active Learning
    Cao, Xiangyong
    Yao, Jing
    Xu, Zongben
    Meng, Deyu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (07): : 4604 - 4616
  • [2] Hyperspectral Image Classification with Convolutional Neural Networks
    Slavkovikj, Viktor
    Verstockt, Steven
    De Neve, Wesley
    Van Hoecke, Sofie
    Van de Walle, Rik
    MM'15: PROCEEDINGS OF THE 2015 ACM MULTIMEDIA CONFERENCE, 2015, : 1159 - 1162
  • [3] Rotation Equivariant Convolutional Neural Networks for Hyperspectral Image Classification
    Paoletti, Mercedes E.
    Haut, Juan M.
    Roy, Swalpa Kumar
    Hendrix, Eligius M. T.
    IEEE ACCESS, 2020, 8 : 179575 - 179591
  • [4] Morphological Convolutional Neural Networks for Hyperspectral Image Classification
    Roy, Swalpa Kumar
    Mondal, Ranjan
    Paoletti, Mercedes E.
    Haut, Juan M.
    Plaza, Antonio
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 8689 - 8702
  • [5] Structure-Adaptive Convolutional Neural Network for Hyperspectral Image Classification
    Jia, Sen
    Bi, Dongsheng
    Liao, Jianhui
    Jiang, Shuguo
    Xu, Meng
    Zhang, Shuyu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [6] Graph Convolutional Networks for Hyperspectral Image Classification
    Hong, Danfeng
    Gao, Lianru
    Yao, Jing
    Zhang, Bing
    Plaza, Antonio
    Chanussot, Jocelyn
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (07): : 5966 - 5978
  • [7] Improved Convolutional Neural Networks for Hyperspectral Image Classification
    Kalita, Shashanka
    Biswas, Mantosh
    RECENT DEVELOPMENTS IN MACHINE LEARNING AND DATA ANALYTICS, 2019, 740 : 397 - 410
  • [8] Convolutional neural networks for hyperspectral image classification
    Yu, Shiqi
    Jia, Sen
    Xu, Chunyan
    NEUROCOMPUTING, 2017, 219 : 88 - 98
  • [9] Iterative Random Training Sampling Convolutional Neural Network for Hyperspectral Image Classification
    Chang, Chein-I
    Liang, Chia-Chen
    Hu, Peter Fuming
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [10] Heterogeneous Transfer Learning for Hyperspectral Image Classification Based on Convolutional Neural Network
    He, Xin
    Chen, Yushi
    Ghamisi, Pedram
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (05): : 3246 - 3263