Hyperspectral Image Classification Based on Convolution Neural Network with Attention Mechanism

被引:8
作者
Chen Wenhao [1 ]
Jing, He [1 ]
Gang, Liu [1 ,2 ]
机构
[1] Chengdu Univ Technol, Coll Earth Sci, Chengdu 610059, Sichuan, Peoples R China
[2] Chengdu Univ Technol, State Key Lab Geohazard Prevent & Geoenvironm Pro, Chengdu 610059, Sichuan, Peoples R China
关键词
imaging systems; hyperspectral image; convolution neural network; residual structure; attention mechanism;
D O I
10.3788/LOP202259.1811001
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In recent years, convolutional neural network (CNN), as a representative of the deep learning method, has gradually become a research hotspot in the field of hyperspectral image (HSI) classification because it does not require complex data preprocessing and feature design. In this paper, a deep CNN model with an attention mechanism is proposed based on an existing neural network model combined with the HSI data characteristics. The model used a residual structure to construct a deep CNN to extract spatial-spectral features and introduced a channel attention mechanism to recalibrate the extracted features. According to different importance levels of features, the attention mechanism assigned different weights to features on different channels, highlighted important features, and controlled unimportant features. Experiments were conducted at Indian Pines and Pavia University to validate the proposed technique. When the spatial size of the dataset was 19 x 19, the Indian Pines and Pavia University datasets were divided into 3 : 1 : 6 and 1 : 1 : 8, respectively. Additionally, these datasets have the best classification accuracy. The average overall accuracy, average accuracy, and average Kappa coefficient obtained are 99. 55%, 99. 31%, and 99. 45%, respectively. The experimental results show that deep CNN with residual structure can extract high spatial-spectral features of the HST. Additionally, the attention mechanism recalibrates the features to strengthen the important features, thereby effectively enhancing the HSI's classification accuracy.
引用
收藏
页数:8
相关论文
共 22 条
[1]   Classification of hyperspectral data from urban areas based on extended morphological profiles [J].
Benediktsson, JA ;
Palmason, JA ;
Sveinsson, JR .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2005, 43 (03) :480-491
[2]   Spectral-spatial K-Nearest Neighbor approach for hyperspectral image classification [J].
Bo, Chunjuan ;
Lu, Huchuan ;
Wang, Dong .
MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (09) :10419-10436
[3]   Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks [J].
Chen, Yushi ;
Jiang, Hanlu ;
Li, Chunyang ;
Jia, Xiuping ;
Ghamisi, Pedram .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (10) :6232-6251
[4]   Spectral and Spatial Classification of Hyperspectral Data Using SVMs and Morphological Profiles [J].
Fauvel, Mathieu ;
Benediktsson, Jon Atli ;
Chanussot, Jocelyn ;
Sveinsson, Johannes R. .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2008, 46 (11) :3804-3814
[5]   Hyperspectral image classification with SVM and guided filter [J].
Guo, Yanhui ;
Yin, Xijie ;
Zhao, Xuechen ;
Yang, Dongxin ;
Bai, Yu .
EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2019, 2019 (1)
[6]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[7]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/CVPR.2018.00745, 10.1109/TPAMI.2019.2913372]
[8]   Deep Convolutional Neural Networks for Hyperspectral Image Classification [J].
Hu, Wei ;
Huang, Yangyu ;
Wei, Li ;
Zhang, Fan ;
Li, Hengchao .
JOURNAL OF SENSORS, 2015, 2015
[9]  
Hu X, 2020, ACTA OPT SIN, V40
[10]   Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network [J].
Li, Ying ;
Zhang, Haokui ;
Shen, Qiang .
REMOTE SENSING, 2017, 9 (01)