Hyperspectral image classification based on adaptive spectral feature decoupling with global local feature fusion network

被引:1
作者
Zhao, Yunji [1 ]
Song, Nailong [1 ]
Bao, Wenming [1 ]
机构
[1] Henan Polytech Univ, Sch Elect Engn & Automat, Henan Int Joint Lab Direct Dr & Control Intelligen, Jiaozuo, Peoples R China
基金
中国国家自然科学基金;
关键词
Adaptive feature fusion; Deep learning (DL); Global local feature fusion network (GLF2Net); Hyperspectral image (HSI) classification;
D O I
10.1007/s12145-024-01415-2
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Deep learning-based methods are widely used in hyperspectral image (HSI) classification and have achieved excellent classification performance. However, hyperspectral data from different categories exhibit strong nonlinear coupling, which results in low spatial distinguishability between samples from different categories. Under the condition of limited sample size, how to extract spectral-spatial features and reduce the coupling of hyperspectral data from different categories is the key to achieving high-precision classification. Some methods based on Convolutional Neural Networks (CNN) tend to focus on local information within hyperspectral cubes. Transformers have excellent performance in modeling global dependencies between sequences. To solve the above problems, this paper proposes a global local feature fusion network (GLF2Net) for hyperspectral classification. To effectively integrate global information, this method introduces frequency domain statistical methods into the field of hyperspectral image classification. Firstly, this paper utilizes Fast Fourier Transform (FFT) to obtain frequency domain information from HSI data. Then, an improved adaptive 13-dimensional frequency domain statistical feature is applied as a supplement to the information after Principal Component Analysis (PCA) dimensionality reduction. To fully capture local-global hyperspectral features from HSI data, a dual-branch structure with a Transformer encoder Convolution Mixer Branch (TCM) and a CNN Branch is designed. Through extensive experiments on real HSI datasets, it is proven that the classification performance of GLF2Net is superior to several classic HSI classification methods.
引用
收藏
页码:4619 / 4637
页数:19
相关论文
共 42 条
[1]  
Aref Mohamed H., 2021, [Journal of Biomedical Photonics & Engineering, Journal of Biomedical Photonics & Engineering], V7, P20302, DOI 10.18287/JBPE21.07.020302
[2]   BS-Nets: An End-to-End Framework for Band Selection of Hyperspectral Image [J].
Cai, Yaoming ;
Liu, Xiaobo ;
Cai, Zhihua .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (03) :1969-1984
[3]   A NEW K-NEAREST NEIGHBOR DENSITY-BASED CLUSTERING METHOD AND ITS APPLICATION TO HYPERSPECTRAL IMAGES [J].
Cariou, Claude ;
Chehdi, Kacem .
2016 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2016, :6161-6164
[4]   Hyperspectral Image Classification Based on Global Spectral Projection and Space Aggregation [J].
Chen, Dong ;
Zhang, Junping ;
Guo, Qingle ;
Wang, Linlin .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
[5]   Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks [J].
Chen, Yushi ;
Jiang, Hanlu ;
Li, Chunyang ;
Jia, Xiuping ;
Ghamisi, Pedram .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (10) :6232-6251
[6]  
Chi L, 2020, FAST FOURIER CONVOLU, V33, P4479
[7]   Rethinking Fast Fourier Convolution in Image Inpainting [J].
Chu, Tianyi ;
Chen, Jiafu ;
Sun, Jiakai ;
Lian, Shuobin ;
Wang, Zhizhong ;
Zuo, Zhiwen ;
Zhao, Lei ;
Xing, Wei ;
Lu, Dongming .
2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, :23138-23148
[8]   SpectralFormer: Rethinking Hyperspectral Image Classification With Transformers [J].
Hong, Danfeng ;
Han, Zhu ;
Yao, Jing ;
Gao, Lianru ;
Zhang, Bing ;
Plaza, Antonio ;
Chanussot, Jocelyn .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[9]  
Dosovitskiy A., 2020, P INT C LEARN REPR I, DOI [DOI 10.48550/ARXIV.2010.11929, 10 . 48550 / ARXIV . 2010 . 11929]
[10]   Challenges and Future Perspectives of Multi-/Hyperspectral Thermal Infrared Remote Sensing for Crop Water-Stress Detection: A Review [J].
Gerhards, Max ;
Schlerf, Martin ;
Mallick, Kaniska ;
Udelhoven, Thomas .
REMOTE SENSING, 2019, 11 (10)