2SRS: Two-Stream Residual Separable Convolution Neural Network for Hyperspectral Image Classification

被引:9
作者
Zahisham, Zharfan [1 ]
Lim, Kian Ming [1 ]
Koo, Voon Chet [2 ]
Chan, Yee Kit [2 ]
Lee, Chin Poo [1 ]
机构
[1] Multimedia Univ, Fac Informat Sci & Technol FIST, Melaka 75450, Malaysia
[2] Multimedia Univ, Fac Engn & Technol, Melaka 75450, Malaysia
关键词
Convolution; Hyperspectral imaging; Training; Feature extraction; Spatial databases; Image classification; Kernel; Convolutional neural networks (CNNs); hyperspectral image classification; remote sensing; residual learning; separable; 2-D-CNN;
D O I
10.1109/LGRS.2023.3241720
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Typically, hyperspectral image suffers from redundant information, data scarcity, and class imbalance problems. This letter proposes a hyperspectral image classification framework named a two-stream residual separable convolution (2SRS) network that aims to mitigate these problems. Principal component analysis (PCA) is first employed to reduce the spectral dimension of the hyperspectral image. Subsequently, the data scarcity and class imbalance problems are overcome via spatial and spectral data augmentations. A novel spectral data creation from image patches is proposed. The augmented samples are fed into the proposed 2SRS network for hyperspectral image classification. We evaluated the proposed method on three benchmark datasets, namely, 1) Indian Pines (IP); 2) Pavia University; and 3) Salinas Scene (SA). The proposed method achieved state-of-the-art performance in terms of overall accuracy (OA), average accuracy (AA), and Kappa coefficient (Kappa) for both 30% and 10% training set ratios.
引用
收藏
页数:5
相关论文
共 18 条
[11]  
Luo YA, 2018, 2018 INTERNATIONAL CONFERENCE ON AUDIO, LANGUAGE AND IMAGE PROCESSING (ICALIP), P464, DOI 10.1109/ICALIP.2018.8455251
[12]  
Makantasis K, 2015, INT GEOSCI REMOTE SE, P4959, DOI 10.1109/IGARSS.2015.7326945
[13]  
Moraga J., 2022, arXiv
[14]   Attention-Based Adaptive SpectralSpatial Kernel ResNet for Hyperspectral Image Classification [J].
Roy, Swalpa Kumar ;
Manna, Suvojit ;
Song, Tiecheng ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (09) :7831-7843
[15]   Generative Adversarial Minority Oversampling for SpectralSpatial Hyperspectral Image Classification [J].
Roy, Swalpa Kumar ;
Haut, Juan M. ;
Paoletti, Mercedes E. ;
Dubey, Shiv Ram ;
Plaza, Antonio .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[16]   HybridSN: Exploring 3-D-2-D CNN Feature Hierarchy for Hyperspectral Image Classification [J].
Roy, Swalpa Kumar ;
Krishna, Gopal ;
Dubey, Shiv Ram ;
Chaudhuri, Bidyut B. .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (02) :277-281
[17]   BASS Net: Band-Adaptive Spectral-Spatial Feature Learning Neural Network for Hyperspectral Image Classification [J].
Santara, Anirban ;
Mani, Kaustubh ;
Hatwar, Pranoot ;
Singh, Ankit ;
Garg, Ankur ;
Padia, Kirti ;
Mitra, Pabitra .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (09) :5293-5301
[18]   FPGA: Fast Patch-Free Global Learning Framework for Fully End-to-End Hyperspectral Image Classification [J].
Zheng, Zhuo ;
Zhong, Yanfei ;
Ma, Ailong ;
Zhang, Liangpei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (08) :5612-5626