Spatial-spectral morphological mamba for hyperspectral image classification

被引:6
作者
Ahmad, Muhammad [1 ]
Butt, Muhammad Hassaan Farooq [2 ]
Khan, Adil Mehmood [3 ]
Mazzara, Manuel [4 ]
Distefano, Salvatore [1 ]
Usama, Muhammad [5 ]
Roy, Swalpa Kumar [6 ]
Chanussot, Jocelyn [7 ]
Hong, Danfeng [8 ,9 ]
机构
[1] Univ Messina, Dipartimento Matemat & Informat MIFT, I-98121 Messina, Italy
[2] Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China
[3] Univ Hull, Sch Comp Sci, Kingston Upon Hull HU6 7RX, England
[4] Innopolis Univ, Inst Software Dev & Engn, Innopolis 420500, Russia
[5] Natl Univ Comp & Emerging Sci, Dept Comp Sci, Chiniot 35400, Pakistan
[6] Alipurduar Govt Engn & Management Coll, Dept Comp Sci & Engn, Alipurduar 736206, W Bengal, India
[7] Univ Grenoble Alpes, CNRS, Grenoble INP, Inria,LJK, F-38000 Grenoble, France
[8] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[9] Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing 100049, Peoples R China
关键词
Hyperspectral imaging; Morphological operations; Spatial morphological mamba (SMM); Spatial-spectral morphological mamba (SSMM); Hyperspectral image classification;
D O I
10.1016/j.neucom.2025.129995
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent advancements in transformers, specifically self-attention mechanisms, have significantly improved hyperspectral image (HSI) classification. However, these models often have inefficiencies, as their computational complexity scales quadratically with sequence length. To address these challenges, we propose the morphological spatial mamba (SMM) and morphological spatial-spectral Mamba (SSMM) model (MorpMamba), which combines the strengths of morphological operations and the state space model framework, offering a more computationally efficient alternative to transformers. In MorpMamba, a novel token generation module first converts HSI patches into spatial-spectral tokens. These tokens are then processed through morphological operations such as erosion and dilation, utilizing depthwise separable convolutions to capture structural and shape information. A token enhancement module refines these features by dynamically adjusting the spatial and spectral tokens based on central HSI regions, ensuring effective feature fusion within each block. Subsequently, multi-head self-attention is applied to enrich the feature representations further, allowing the model to capture complex relationships and dependencies within the data. Finally, the enhanced tokens are fed into a state space module, which efficiently models the temporal evolution of the features for classification. Experimental results on widely used HSI datasets demonstrate that MorpMamba achieves superior parametric efficiency compared to traditional CNN and transformer models while maintaining high accuracy. The source code is available at https://github.com/mahmad000/MorpMamba.
引用
收藏
页数:12
相关论文
共 50 条
[1]   Multi-head spatial-spectral mamba for hyperspectral image classification [J].
Ahmad, Muhammad ;
Butt, Muhammad Hassaan Farooq ;
Usama, Muhammad ;
Altuwaijri, Hamad Ahmed ;
Mazzara, Manuel ;
Distefano, Salvatore ;
Khan, Adil Mehmood .
REMOTE SENSING LETTERS, 2025, 16 (04) :15-29
[2]   WaveMamba: Spatial-Spectral Wavelet Mamba for Hyperspectral Image Classification [J].
Ahmad, Muhammad ;
Usama, Muhammad ;
Mazzara, Manuel ;
Distefano, Salvatore .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2025, 22
[3]   HYPERSPECTRAL IMAGE CLASSIFICATION WITH FUZZY SPATIAL-SPECTRAL CLASS DISCRIMINATE INFORMATION [J].
Ahmad, Muhammad ;
Usama, Muhammad ;
Distefano, Salvatore ;
Mazzara, Manuel .
2024 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2024, :2285-2291
[4]   Fusing Transformers in a Tuning Fork Structure for Hyperspectral Image Classification Across Disjoint Samples [J].
Ahmad, Muhammad ;
Usama, Muhammad ;
Mazzara, Manuel ;
Distefano, Salvatore ;
Altuwaijri, Hamad Ahmed ;
Ullo, Silvia Liberata .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 :18167-18181
[5]   Pyramid Hierarchical Spatial-Spectral Transformer for Hyperspectral Image Classification [J].
Ahmad, Muhammad ;
Butt, Muhammad Hassaan Farooq ;
Mazzara, Manuel ;
Distefano, Salvatore ;
Khan, Adil Mehmood ;
Altuwaijri, Hamad Ahmed .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 :17681-17689
[6]   Spatial-Spectral Transformer With Conditional Position Encoding for Hyperspectral Image Classification [J].
Ahmad, Muhammad ;
Usama, Muhammad ;
Khan, Adil Mehmood ;
Distefano, Salvatore ;
Altuwaijri, Hamad Ahmed ;
Mazzara, Manuel .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
[7]   Hybrid Dense Network With Attention Mechanism for Hyperspectral Image Classification [J].
Ahmad, Muhammad ;
Khan, Adil Mehmood ;
Mazzara, Manuel ;
Distefano, Salvatore ;
Roy, Swalpa Kumar ;
Wu, Xin .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 :3948-3957
[8]   Hyperspectral Image Classification-Traditional to Deep Models: A Survey for Future Prospects [J].
Ahmad, Muhammad ;
Shabbir, Sidrah ;
Roy, Swalpa Kumar ;
Hong, Danfeng ;
Wu, Xin ;
Yao, Jing ;
Khan, Adil Mehmood ;
Mazzara, Manuel ;
Distefano, Salvatore ;
Chanussot, Jocelyn .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 :968-999
[9]   A Fast and Compact 3-D CNN for Hyperspectral Image Classification [J].
Ahmad, Muhammad ;
Khan, Adil Mehmood ;
Mazzara, Manuel ;
Distefano, Salvatore ;
Ali, Mohsin ;
Sarfraz, Muhammad Shahzad .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[10]   A hybrid convolution transformer for hyperspectral image classification [J].
Arshad, Tahir ;
Zhang, Junping ;
Ullah, Inam .
EUROPEAN JOURNAL OF REMOTE SENSING, 2024, 57 (01)