Enhancing Precision Agriculture and Land Cover Classification: A Self-Attention 3D Convolutional Neural Network Approach for Hyperspectral Image Analysis

被引:5
作者
Kishor Kumar Reddy, C. [1 ]
Daduvy, Advaitha [1 ]
Madana Mohana, R. [2 ]
Assiri, Basem [3 ]
Shuaib, Mohammed [3 ]
Alam, Shadab [3 ]
Abdullah Sheneamer, and M. [3 ]
机构
[1] Stanley Coll Engn & Technol Women, Dept Comp Sci & Engn, Hyderabad 500001, Telangana, India
[2] Chaithanya Bharathi Inst Technol, Dept Artificial Intelligence & Machine Learning, Hyderabad 500075, India
[3] Jazan Univ, Coll Engn & Comp Sci, Dept Comp Sci, Jazan 45142, Saudi Arabia
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Hyperspectral imaging; Convolutional neural networks; Three-dimensional displays; Accuracy; Deep learning; Image classification; Data models; Remote sensing; Precision agriculture; hyperspectral image classification; remote sensing; precision agriculture;
D O I
10.1109/ACCESS.2024.3420089
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Hyperspectral imagery, capturing information beyond the visible spectrum, is essential for many remote sensing applications. This paper introduces a novel approach utilizing a 3D Convolutional Neural Network (CNN) enhanced with self-attention mechanism to address the limitations of traditional architectures in hyperspectral image classification. The main problem tackled is the effective extraction of both spatial and spectral features from complex hyperspectral datasets. Our proposed model simultaneously analyzes spatial and spectral dimensions with improved accuracy and adaptability through self-attention. We systematically evaluate the performance of 1D CNN, 2D CNN, and 3D CNN models, alongside Multi-Column Neural Network (MCNN) and Hybrid Spectral Network (Hybrid SN) models, comparing them to our proposed approach. The evaluation, conducted on the Indian Pines and Salinas datasets, highlights significant improvements in classification accuracy and adaptability. Specifically, the proposed 3D CNN with self-attention achieves accuracy values of 98.45% and 91.32% on the Indian Pines and Salinas datasets, respectively. This paper provides critical insights for data scientists and remote sensing experts, contributing to informed decision-making in selecting CNN models tailored to specific application requirements and advancing the field of hyperspectral image classification (HSIC). Furthermore, our approach shows improved handling of the complex spectral variability and spatial heterogeneity inherent in hyperspectral data.
引用
收藏
页码:125592 / 125608
页数:17
相关论文
共 42 条
[1]   Hyperspectral Image Classification-Traditional to Deep Models: A Survey for Future Prospects [J].
Ahmad, Muhammad ;
Shabbir, Sidrah ;
Roy, Swalpa Kumar ;
Hong, Danfeng ;
Wu, Xin ;
Yao, Jing ;
Khan, Adil Mehmood ;
Mazzara, Manuel ;
Distefano, Salvatore ;
Chanussot, Jocelyn .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 :968-999
[2]  
Alhayani B, 2017, IJIREEICE, V5, P71, DOI DOI 10.17148/IJIREEICE.2017.5414
[3]   Structure Aware Generative Adversarial Networks for Hyperspectral Image Classification [J].
Alipour-Fard, Tayeb ;
Arefi, Hossein .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :5424-5438
[4]   Deep Learning for Classification of Hyperspectral Data [J].
Audebert, Nicolas ;
Le Saux, Bertrand ;
Lefevre, Sebastien .
IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2019, 7 (02) :159-173
[5]  
Brisco B., 1998, Can. J. Remote Sens., V24, P315
[6]  
Camps-Valls G, 2014, IEEE SIGNAL PROC MAG, V31, P45, DOI 10.1109/MSP.2013.2279179
[7]   Hyperspectral Image Classification With Convolutional Neural Network and Active Learning [J].
Cao, Xiangyong ;
Yao, Jing ;
Xu, Zongben ;
Meng, Deyu .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (07) :4604-4616
[8]   Hyperspectral classification based on spectral-spatial convolutional neural networks [J].
Chen, Congcong ;
Jiang, Feng ;
Yang, Chifu ;
Rho, Seungmin ;
Shen, Weizheng ;
Liu, Shaohui ;
Liu, Zhiguo .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2018, 68 :165-171
[9]   Hyperspectral Remote Sensing Image Classification With CNN Based on Quantum Genetic-Optimized Sparse Representation [J].
Chen, Huayue ;
Miao, Fang ;
Shen, Xu .
IEEE ACCESS, 2020, 8 :99900-99909
[10]   Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution [J].
Chen, Yunpeng ;
Fan, Haoqi ;
Xu, Bing ;
Yan, Zhicheng ;
Kalantidis, Yannis ;
Rohrbach, Marcus ;
Yan, Shuicheng ;
Feng, Jiashi .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3434-3443