HybridGT: An Integration of Graph Transformer and LSTM for Effective Hyperspectral Band Selection

被引:0
作者
Neela, Nagaraju [1 ]
Veerakumar, T. [1 ]
Panda, Manoj Kumar [2 ]
Subudhi, Badri Narayan [3 ]
Esakkirajan, S. [4 ]
Bouwmans, Thierry [5 ]
机构
[1] Natl Inst Technol Goa, Dept Elect & Commun Engn, Cuncolim 403703, Goa, India
[2] GIET Univ, Dept Elect & Commun Engn, Gunupur, Rayagada, India
[3] Indian Inst Technol Jammu, Dept Elect Engn, Nagrota, Jammu, India
[4] PSG Coll Technol, Dept Instrumentat & Control Engn, Coimbatore, India
[5] Univ La Rochelle, Lab MIA, La Rochelle, France
关键词
Hyperspectral imagery (HSI); graph transformer (GT); band selection (BS); resNet-50; long short term memory (LSTM); Bi-dimensional empirical mode decomposition (BEMD); CLASSIFICATION;
D O I
10.1080/01431161.2024.2431174
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Hyperspectral imagery has a high-dimensional curse due to numerous spectral bands. Band selection (BS) is crucial for efficiently reducing dimensionality, retaining only essential bands containing valuable information. However, deep learning-based techniques have gained more attention through trained networks for band selection. Recently, graph-based learning has been extensively used in hyperspectral imagery, revealing intrinsic data relationships. This article presents a novel hybrid approach for hyperspectral band selection, addressing the curse of dimensionality in hyperspectral imagery (HSI). Integrating Long Short Term Memory (LSTM) and Graph Transformer (GT), the method employs Bi-dimensional Empirical Mode Decomposition (BEMD) for spatial data enhancement. Using transfer learning, we explore a ResNet-50 deep network to identify optimal intrinsic mode functions (IMFs). The final band subset will be obtained by concatenating the features extracted from the graph transformer and LSTM networks from selected IMFs and residual IMF, respectively. The proposed HybridGT-BS technique surpasses state-of-the-art methods in classification accuracy across three well-known HSI datasets - IP-Indian Pines, SA-Salinas, and PU-PaviaU. With the support of experimental results, the proposed technique significantly outperforms the classification accuracy with the best bands of the HSIs.
引用
收藏
页码:1403 / 1431
页数:29
相关论文
共 43 条
  • [1] Deep Learning for Classification of Hyperspectral Data
    Audebert, Nicolas
    Le Saux, Bertrand
    Lefevre, Sebastien
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2019, 7 (02) : 159 - 173
  • [2] Potential application of hyperspectral imaging in food grain quality inspection, evaluation and control during bulk storage
    Aviara, Ndubisi A.
    Liberty, Jacob Tizhe
    Olatunbosun, Ojo S.
    Shoyombo, Habib A.
    Oyeniyi, Samuel K.
    [J]. JOURNAL OF AGRICULTURE AND FOOD RESEARCH, 2022, 8
  • [3] Efficient Graph Convolutional Self-Representation for Band Selection of Hyperspectral Image
    Cai, Yaoming
    Zhang, Zijia
    Liu, Xiaobo
    Cai, Zhihua
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 4869 - 4880
  • [4] BS-Nets: An End-to-End Framework for Band Selection of Hyperspectral Image
    Cai, Yaoming
    Liu, Xiaobo
    Cai, Zhihua
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (03): : 1969 - 1984
  • [5] A semi-supervised spatially aware wrapper method for hyperspectral band selection
    Cao, Xianghai
    Ji, Yamei
    Liang, Tian
    Li, Zehan
    Li, Xinghua
    Han, Jungong
    Jiao, Licheng
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2018, 39 (12) : 4020 - 4039
  • [6] Chowdhary KR., 2020, Fundamentals of Artificial Intelligence, P603, DOI [DOI 10.1007/978-81-322-3972-719, 10.1007/978-81-322-3972-7_19, DOI 10.1007/978-81-322-3972-7_19]
  • [7] Local Information-Enhanced Graph-Transformer for Hyperspectral Image Change Detection With Limited Training Samples
    Dong, Wenqian
    Yang, Yufei
    Qu, Jiahui
    Xiao, Song
    Li, Yunsong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [8] Improved Residual Networks for Image and Video Recognition
    Duta, Ionut Cosmin
    Liu, Li
    Zhu, Fan
    Shao, Ling
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 9415 - 9422
  • [9] Hyperspectral Image Band Selection Based on CNN Embedded GA (CNNeGA)
    Esmaeili, Mohammad
    Abbasi-Moghadam, Dariush
    Sharifi, Alireza
    Tariq, Aqil
    Li, Qingting
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 1927 - 1950
  • [10] Deep Reinforcement Learning for Semisupervised Hyperspectral Band Selection
    Feng, Jie
    Li, Di
    Gu, Jing
    Cao, Xianghai
    Shang, Ronghua
    Zhang, Xiangrong
    Jiao, Licheng
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60