Effective hyperspectral image classification based on segmented PCA and 3D-2D CNN leveraging multibranch feature fusion

被引:5
作者
Afjal, Masud Ibn [1 ,2 ]
Mondal, Md. Nazrul Islam [2 ]
Mamun, Md. Al [2 ]
机构
[1] Hajee Mohammad Danesh Sci & Technol Univ, Comp Sci & Engn, Dinajpur, Bangladesh
[2] Rajshahi Univ Engn & Technol, Comp Sci & Engn, Rajshahi, Bangladesh
关键词
Convolutional neural networks; remote sensing; hyperspectral image classification; deep learning; segmented PCA; multi-branch 3D-2D CNN; feature fusion; GRAPH CONVOLUTIONAL NETWORKS; PRINCIPAL COMPONENT ANALYSIS; THEORETIC FEATURE-SELECTION; INFORMATION;
D O I
10.1080/14498596.2024.2305119
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
We present an innovative hyperspectral image (HSI) classification method addressing challenges posed by closely spaced wavelength bands. Our approach combines 3D-2D convolutional neural networks (CNNs) with multi-branch feature fusion for improved spectral-spatial feature extraction. Using segmented principal component analysis (Seg-PCA), we reduce HSIs' spectral dimensions into global and local intrinsic characteristics. The integration of 3D and 2D CNNs captures joint spectral-spatial features, while a multi-branch network extracts and merges diverse local features along the spectral dimension. Our method outperforms existing approaches, achieving remarkable accuracy of 99.27%, 100%, and 99.99% on Indian Pines, Salinas Scene, and University of Pavia datasets, respectively.
引用
收藏
页码:821 / 848
页数:28
相关论文
共 63 条
[11]   Spectral-Spatial Classification of Hyperspectral Data Based on Deep Belief Network [J].
Chen, Yushi ;
Zhao, Xing ;
Jia, Xiuping .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2015, 8 (06) :2381-2392
[12]   Optimised U-Net for Land Use-Land Cover Classification Using Aerial Photography [J].
Clark, Andrew ;
Phinn, Stuart ;
Scarth, Peter .
PFG-JOURNAL OF PHOTOGRAMMETRY REMOTE SENSING AND GEOINFORMATION SCIENCE, 2023, 91 (02) :125-147
[13]   Folded LDA: Extending the Linear Discriminant Analysis Algorithm for Feature Extraction and Data Reduction in Hyperspectral Remote Sensing [J].
Fabiyi, Samson Damilola ;
Murray, Paul ;
Zabalza, Jaime ;
Ren, Jinchang .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :12312-12331
[14]   Classification of Hyperspectral Images by Exploiting Spectral-Spatial Information of Superpixel via Multiple Kernels [J].
Fang, Leyuan ;
Li, Shutao ;
Duan, Wuhui ;
Ren, Jinchang ;
Benediktsson, Jon Atli .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (12) :6663-6674
[15]  
Gamba P, 2004, INT GEOSCI REMOTE SE, P69
[16]   Hyperspectral Image Classification Method Based on 2D-3D CNN and Multibranch Feature Fusion [J].
Ge, Zixian ;
Cao, Guo ;
Li, Xuesong ;
Fu, Peng .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :5776-5788
[17]  
GIC, 2021, HYPERSPECTRAL REMOTE
[18]   A CNN-Based Spatial Feature Fusion Algorithm for Hyperspectral Imagery Classification [J].
Guo, Alan J. X. ;
Zhu, Fei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (09) :7170-7181
[19]   HyMap imagery for copper and manganese prospecting in the east of Ameln valley shear zone (Kerdous inlier, western Anti-Atlas, Morocco) [J].
Hajaj, Soufiane ;
El Harti, Abderrazak ;
Jellouli, Amine ;
Pour, Amin Beiranvand ;
Himyari, Saloua Mnissar ;
Hamzaoui, Abderrazak ;
Bensalah, Mohamed Khalil ;
Benaouiss, Naima ;
Hashim, Mazlan .
JOURNAL OF SPATIAL SCIENCE, 2024, 69 (01) :81-102
[20]   Hyperspectral images classification based on multiple kernel learning using SWT and KMNF with few training samples [J].
Hassanzadeh, Shirin ;
Danyali, Habibollah ;
Helfroush, Mohammad Sadegh .
JOURNAL OF SPATIAL SCIENCE, 2023, 68 (04) :593-613