Multi-Scale Spectral-Spatial Attention Network for Hyperspectral Image Classification Combining 2D Octave and 3D Convolutional Neural Networks

被引:7
作者
Liang, Lianhui [1 ]
Zhang, Shaoquan [2 ]
Li, Jun [3 ]
Plaza, Antonio [4 ]
Cui, Zhi [1 ]
机构
[1] Hunan Univ, Coll Elect & Informat Engn, Changsha 418002, Peoples R China
[2] Nanchang Inst Technol, Sch Informat Engn, Jiangxi Prov Key Lab Water Informat Cooperat Sensi, Nanchang 330099, Peoples R China
[3] China Univ Geosci, Sch Comp Sci, Hubei Key Lab Intelligent Geoinformat Proc, Wuhan 430078, Peoples R China
[4] Univ Extremadura, Dept Technol Comp & Commun, Hyperspectral Comp Lab, E-10071 Caceres, Spain
关键词
hyperspectral images (HSIs); deep learning; convolutional neural networks (CNNs); 2D octave convolution; DenseNet; FUSION;
D O I
10.3390/rs15071758
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Traditional convolutional neural networks (CNNs) can be applied to obtain the spectral-spatial feature information from hyperspectral images (HSIs). However, they often introduce significant redundant spatial feature information. The octave convolution network is frequently utilized instead of traditional CNN to decrease spatial redundant information of the network and extend its receptive field. However, the 3D octave convolution-based approaches may introduce extensive parameters and complicate the network. To solve these issues, we propose a new HSI classification approach with a multi-scale spectral-spatial network-based framework that combines 2D octave and 3D CNNs. Our method, called MOCNN, first utilizes 2D octave convolution and 3D DenseNet branch networks with various convolutional kernel sizes to obtain complex spatial contextual feature information and spectral characteristics, separately. Moreover, the channel and the spectral attention mechanisms are, respectively, applied to these two branch networks to emphasize significant feature regions and certain important spectral bands that comprise discriminative information for the categorization. Furthermore, a sample balancing strategy is applied to address the sample imbalance problem. Expansive experiments are undertaken on four HSI datasets, demonstrating that our MOCNN approach outperforms several other methods for HSI classification, especially in scenarios dominated by limited and imbalanced sample data.
引用
收藏
页数:24
相关论文
共 50 条
  • [1] Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network
    Li, Ying
    Zhang, Haokui
    Shen, Qiang
    REMOTE SENSING, 2017, 9 (01)
  • [2] A 3D Cascaded Spectral-Spatial Element Attention Network for Hyperspectral Image Classification
    Yan, Huaiping
    Wang, Jun
    Tang, Lei
    Zhang, Erlei
    Yan, Kun
    Yu, Kai
    Peng, Jinye
    REMOTE SENSING, 2021, 13 (13)
  • [3] A lightweight 3D-2D convolutional neural network for spectral-spatial classification of hyperspectral images
    Haque, Md Rakibul
    Mishu, Sadia Zaman
    Uddin, Md Palash
    Al Mamun, Md
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 43 (01) : 1241 - 1258
  • [4] HYPERSPECTRAL IMAGE CLASSIFICATION USING SPECTRAL-SPATIAL CONVOLUTIONAL NEURAL NETWORKS
    Nalepa, Jakub
    Tulczyjew, Lukasz
    Myller, Michal
    Kawulok, Michal
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 866 - 869
  • [5] Residual Spectral-Spatial Attention Network for Hyperspectral Image Classification
    Zhu, Minghao
    Jiao, Licheng
    Liu, Fang
    Yang, Shuyuan
    Wang, Jianing
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (01): : 449 - 462
  • [6] HYPERSPECTRAL IMAGE CLASSIFICATION VIA DOUBLE-BRANCH MULTI-SCALE SPECTRAL-SPATIAL CONVOLUTION NETWORK
    Liang, Lianhui
    Zhang, Shaoquan
    Li, Jun
    Cui, Zhi
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 3588 - 3591
  • [7] Cross-Attention Spectral-Spatial Network for Hyperspectral Image Classification
    Yang, Kai
    Sun, Hao
    Zou, Chunbo
    Lu, Xiaoqiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [8] Spectral-spatial attention bilateral network for hyperspectral image classification
    Yang X.
    Chi Y.
    Zhou Y.
    Wang Y.
    National Remote Sensing Bulletin, 2023, 27 (11) : 2565 - 2578
  • [9] Expansion Spectral-Spatial Attention Network for Hyperspectral Image Classification
    Wang, Shuo
    Liu, Zhengjun
    Chen, Yiming
    Hou, Chengchao
    Liu, Aixia
    Zhang, Zhenbei
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 6411 - 6427
  • [10] Hierarchical Multi-Scale Convolutional Neural Networks for Hyperspectral Image Classification
    Li, Simin
    Zhu, Xueyu
    Bao, Jie
    SENSORS, 2019, 19 (07)