Semi-Active Convolutional Neural Networks for Hyperspectral Image Classification

被引:50
|
作者
Yao, Jing [1 ]
Cao, Xiangyong [2 ,3 ]
Hong, Danfeng [1 ]
Wu, Xin [4 ]
Meng, Deyu [5 ,6 ]
Chanussot, Jocelyn [7 ,8 ]
Xu, Zongben [5 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Comp Sci & Technol, Xian 710049, Peoples R China
[3] Minist Educ, Key Lab Intelligent Networks & Network Secur, Xian 710049, Peoples R China
[4] Beijing Univ Posts & Telecommun, Sch Comp Sci, Natl Pilot Software Engn Sch, Beijing 100876, Peoples R China
[5] Xi An Jiao Tong Univ, Sch Math & Stat, Xian 710049, Peoples R China
[6] Macau Univ Sci & Technol, Macau Inst Syst Engn, Taipa, Macao, Peoples R China
[7] Univ Grenoble Alpes, GIPSA Lab, CNRS, Grenoble INP, F-38000 Grenoble, France
[8] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
基金
中国国家自然科学基金;
关键词
Training; Feature extraction; Schedules; Convolutional neural networks; Iterative methods; Image segmentation; Hyperspectral imaging; Active learning; classification; convolutional neural network (CNN); deep learning (DL); hyperspectral; pseudolabel; remote sensing; semi-supervised learning; superpixel segmentation; MANIFOLD ALIGNMENT; REGRESSION; FRAMEWORK; LABELS; JOINT;
D O I
10.1109/TGRS.2022.3206208
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Owing to the powerful data representation ability of deep learning (DL) techniques, tremendous progress has been recently made in hyperspectral image (HSI) classification. Convolutional neural network (CNN), as a main part of the DL family, has been proven to be considerably effective to extract spatial-spectral features for HSIs. Nevertheless, its classification performance, to a great extent, depends on the quality and quantity of samples in the network training process. To select those samples, either labeled or unlabeled, which can be used to enhance the generalization ability of CNNs and further improve the classification accuracy, we propose an iterative semi-supervised CNNs framework by means of active learning and superpixel segmentation techniques, dubbed as semi-active CNNs (SA-CNNs), for HSI classification. More specifically, we start to pretrain a CNN-based model on a small-scale unbiased labeled set and infer unlabeled data using the trained model, i.e., generating pseudolabels. Then, the reliable samples, which consist of two parts: high label homogeneity and most informativeness, are actively selected from superpixel segments. These selected labeled and unlabeled samples with their labels and pseudolabels are refed into the next-round network training. Moreover, three different schedules, i.e., log-, exp-, and linear-schedules, are progressively adopted to fully explore their potentials in sample selection, until a labeling budget is finally reached. Extensive experiments are conducted on three benchmark HSI datasets, demonstrating substantial performance improvements of the proposed SA-CNNs over other similar competitors.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Semi-Active Convolutional Neural Networks for Hyperspectral Image Classification
    Yao, Jing
    Cao, Xiangyong
    Hong, Danfeng
    Wu, Xin
    Meng, Deyu
    Chanussot, Jocelyn
    Xu, Zongben
    IEEE Transactions on Geoscience and Remote Sensing, 2022, 60
  • [2] Convolutional neural networks for hyperspectral image classification
    Yu, Shiqi
    Jia, Sen
    Xu, Chunyan
    NEUROCOMPUTING, 2017, 219 : 88 - 98
  • [3] Hyperspectral Image Classification with Convolutional Neural Networks
    Slavkovikj, Viktor
    Verstockt, Steven
    De Neve, Wesley
    Van Hoecke, Sofie
    Van de Walle, Rik
    MM'15: PROCEEDINGS OF THE 2015 ACM MULTIMEDIA CONFERENCE, 2015, : 1159 - 1162
  • [4] Improved Convolutional Neural Networks for Hyperspectral Image Classification
    Kalita, Shashanka
    Biswas, Mantosh
    RECENT DEVELOPMENTS IN MACHINE LEARNING AND DATA ANALYTICS, 2019, 740 : 397 - 410
  • [5] Hyperspectral Image Classification using Convolutional Neural Networks
    Shambulinga, M.
    Sadashivappa, G.
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2021, 12 (06) : 702 - 708
  • [6] Deformable Convolutional Neural Networks for Hyperspectral Image Classification
    Zhu, Jian
    Fang, Leyuan
    Ghamisi, Pedram
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2018, 15 (08) : 1254 - 1258
  • [7] Deep Convolutional Neural Networks for Hyperspectral Image Classification
    Hu, Wei
    Huang, Yangyu
    Wei, Li
    Zhang, Fan
    Li, Hengchao
    JOURNAL OF SENSORS, 2015, 2015
  • [8] Morphological Convolutional Neural Networks for Hyperspectral Image Classification
    Roy, Swalpa Kumar
    Mondal, Ranjan
    Paoletti, Mercedes E.
    Haut, Juan M.
    Plaza, Antonio
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 8689 - 8702
  • [9] GROUP CONVOLUTIONAL NEURAL NETWORKS FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Li, Xian
    Ding, Mingli
    Pizurica, Aleksandra
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 639 - 643
  • [10] Quaternion convolutional neural networks for hyperspectral image classification
    Zhou, Heng
    Zhang, Xin
    Zhang, Chunlei
    Ma, Qiaoyu
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123