Multi-Scale Spectral-Spatial Attention Network for Hyperspectral Image Classification Combining 2D Octave and 3D Convolutional Neural Networks

被引:7
作者
Liang, Lianhui [1 ]
Zhang, Shaoquan [2 ]
Li, Jun [3 ]
Plaza, Antonio [4 ]
Cui, Zhi [1 ]
机构
[1] Hunan Univ, Coll Elect & Informat Engn, Changsha 418002, Peoples R China
[2] Nanchang Inst Technol, Sch Informat Engn, Jiangxi Prov Key Lab Water Informat Cooperat Sensi, Nanchang 330099, Peoples R China
[3] China Univ Geosci, Sch Comp Sci, Hubei Key Lab Intelligent Geoinformat Proc, Wuhan 430078, Peoples R China
[4] Univ Extremadura, Dept Technol Comp & Commun, Hyperspectral Comp Lab, E-10071 Caceres, Spain
关键词
hyperspectral images (HSIs); deep learning; convolutional neural networks (CNNs); 2D octave convolution; DenseNet; FUSION;
D O I
10.3390/rs15071758
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Traditional convolutional neural networks (CNNs) can be applied to obtain the spectral-spatial feature information from hyperspectral images (HSIs). However, they often introduce significant redundant spatial feature information. The octave convolution network is frequently utilized instead of traditional CNN to decrease spatial redundant information of the network and extend its receptive field. However, the 3D octave convolution-based approaches may introduce extensive parameters and complicate the network. To solve these issues, we propose a new HSI classification approach with a multi-scale spectral-spatial network-based framework that combines 2D octave and 3D CNNs. Our method, called MOCNN, first utilizes 2D octave convolution and 3D DenseNet branch networks with various convolutional kernel sizes to obtain complex spatial contextual feature information and spectral characteristics, separately. Moreover, the channel and the spectral attention mechanisms are, respectively, applied to these two branch networks to emphasize significant feature regions and certain important spectral bands that comprise discriminative information for the categorization. Furthermore, a sample balancing strategy is applied to address the sample imbalance problem. Expansive experiments are undertaken on four HSI datasets, demonstrating that our MOCNN approach outperforms several other methods for HSI classification, especially in scenarios dominated by limited and imbalanced sample data.
引用
收藏
页数:24
相关论文
共 50 条
  • [41] Deep Multi-Scale 3D Convolutional Neural Network (CNN) for MRI Gliomas Brain Tumor Classification
    Hiba Mzoughi
    Ines Njeh
    Ali Wali
    Mohamed Ben Slima
    Ahmed BenHamida
    Chokri Mhiri
    Kharedine Ben Mahfoudhe
    Journal of Digital Imaging, 2020, 33 : 903 - 915
  • [42] Deep Multi-Scale 3D Convolutional Neural Network (CNN) for MRI Gliomas Brain Tumor Classification
    Mzoughi, Hiba
    Njeh, Ines
    Wali, Ali
    Ben Slima, Mohamed
    BenHamida, Ahmed
    Mhiri, Chokri
    Ben Mahfoudhe, Kharedine
    JOURNAL OF DIGITAL IMAGING, 2020, 33 (04) : 903 - 915
  • [43] Comparison of 2D and 3D convolutional neural networks in hyperspectral image analysis of fruits applied to orange bruise detection
    Pourdarbani, Raziyeh
    Sabzi, Sajad
    Zohrabi, Reihaneh
    Garcia-Mateos, Gines
    Fernandez-Beltran, Ruben
    Molina-Martinez, Jose Miguel
    Rohban, Mohammad H.
    JOURNAL OF FOOD SCIENCE, 2023, 88 (12) : 5149 - 5163
  • [44] Patch-based hierarchical residual spectral-spatial convolutional network for hyperspectral image classification
    Zhao, Jinling
    Wu, Keke
    Zhang, Lu
    Huang, Wenjiang
    Ruan, Chao
    Huang, Linsheng
    SIGNAL PROCESSING, 2025, 230
  • [45] End-to-End Convolutional Network and Spectral-Spatial Transformer Architecture for Hyperspectral Image Classification
    Li, Shiping
    Liang, Lianhui
    Zhang, Shaoquan
    Zhang, Ying
    Plaza, Antonio
    Wang, Xuehua
    REMOTE SENSING, 2024, 16 (02)
  • [46] Dimensionality-varied deep convolutional neural network for spectral-spatial classification of hyperspectral data
    Qu, Haicheng
    Liang, Xuejian
    Liang, Shichao
    Liu, Wanjun
    JOURNAL OF APPLIED REMOTE SENSING, 2018, 12
  • [48] SSFAN: A Compact and Efficient Spectral-Spatial Feature Extraction and Attention-Based Neural Network for Hyperspectral Image Classification
    Wang, Chunyang
    Zhan, Chao
    Lu, Bibo
    Yang, Wei
    Zhang, Yingjie
    Wang, Gaige
    Zhao, Zongze
    REMOTE SENSING, 2024, 16 (22)
  • [49] Spectral-Spatial Attention Feature Extraction for Hyperspectral Image Classification Based on Generative Adversarial Network
    Liang, Hongbo
    Bao, Wenxing
    Shen, Xiangfei
    Zhang, Xiaowu
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 10017 - 10032
  • [50] Hyperspectral Image Spatial Super-Resolution via 3D Full Convolutional Neural Network
    Mei, Shaohui
    Yuan, Xin
    Ji, Jingyu
    Zhang, Yifan
    Wan, Shuai
    Du, Qian
    REMOTE SENSING, 2017, 9 (11)