Joint Spatial-Spectral Attention Network for Hyperspectral Image Classification

被引:27
作者
Li, Lei [1 ]
Yin, Jihao [1 ]
Jia, Xiuping [2 ]
Li, Sen [1 ]
Han, Bingnan [1 ]
机构
[1] Beihang Univ, Sch Astronaut, Beijing 100191, Peoples R China
[2] Univ New South Wales, Sch Engn & Informat Technol, Canberra, ACT 2600, Australia
基金
中国国家自然科学基金;
关键词
Attention mechanism; convolutional neural networks (CNNs); feature extraction; hyperspectral image (HSI) classification; FRAMEWORK;
D O I
10.1109/LGRS.2020.3007811
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral images (HSIs) contain rich context information in the spatial domain and spectral domain. To fully explore that information, a data-driven joint spatial-spectral attention network (JSSAN) is proposed in this letter. Specifically, we first design a spatial-spectral attention (S(2)A) block to simultaneously capture long-range interdependency of spatial and spectral data via the similarity evaluation. Then we adopt a weighted sum operation of features at all spatial positions and channels to selectively aggregate discriminative spatial-spectral features. Second, the S(2)A block is inserted into simple convolutional neural network (CNN) structure to extract more representative features for classification, by adaptively emphasizing features of informative land covers and spectral bands which contribute more to class identification. The experimental results reveal that our proposed method outperforms several state-of-the-art algorithms.
引用
收藏
页码:1816 / 1820
页数:5
相关论文
共 23 条
  • [1] Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks
    Chen, Yushi
    Jiang, Hanlu
    Li, Chunyang
    Jia, Xiuping
    Ghamisi, Pedram
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (10): : 6232 - 6251
  • [2] Hyperspectral Images Classification Based on Dense Convolutional Networks with Spectral-Wise Attention Mechanism
    Fang, Bei
    Li, Ying
    Zhang, Haokui
    Chan, Jonathan Cheung-Wai
    [J]. REMOTE SENSING, 2019, 11 (02)
  • [3] Automatic Spectral-Spatial Classification Framework Based on Attribute Profiles and Supervised Feature Extraction
    Ghamisi, Pedram
    Benediktsson, Jon Atli
    Sveinsson, Johannes R.
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (09): : 5771 - 5782
  • [4] Investigation of the random forest framework for classification of hyperspectral data
    Ham, J
    Chen, YC
    Crawford, MM
    Ghosh, J
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2005, 43 (03): : 492 - 501
  • [5] Haut J.M., 2018, IEEE T GEOSCI REMOTE, V56, P6440, DOI [10.1109/TGRS.2018.2838665, DOI 10.1109/TGRS.2018.2838665]
  • [6] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [7] Relation Networks for Object Detection
    Hu, Han
    Gu, Jiayuan
    Zhang, Zheng
    Dai, Jifeng
    Wei, Yichen
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 3588 - 3597
  • [8] Discriminative Reconstruction Constrained Generative Adversarial Network for Hyperspectral Anomaly Detection
    Jiang, Tao
    Li, Yunsong
    Xie, Weiying
    Du, Qian
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (07): : 4666 - 4679
  • [9] Going Deeper With Contextual CNN for Hyperspectral Image Classification
    Lee, Hyungtae
    Kwon, Heesung
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (10) : 4843 - 4855
  • [10] Classification of Hyperspectral Imagery Using a New Fully Convolutional Neural Network
    Li, Jiaojiao
    Zhao, Xi
    Li, Yunsong
    Du, Qian
    Xi, Bobo
    Hu, Jing
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2018, 15 (02) : 292 - 296