Hyperspectral Image Classification Using Geometric Spatial-Spectral Feature Integration: A Class Incremental Learning Approach

被引:8
作者
Bai, Jing [1 ]
Liu, Ruotong [1 ]
Zhao, Haisheng [2 ]
Xiao, Zhu [3 ]
Chen, Zheng [1 ]
Shi, Wei [1 ]
Xiong, Yong [3 ,4 ]
Jiao, Licheng [1 ]
机构
[1] Xidian Univ, Sch Artificial Intelligence, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian 710071, Peoples R China
[2] China Res Inst Radiowave Propagat, Natl Key Lab Electromagnet Environm, Qingdao 266107, Shandong, Peoples R China
[3] Hunan Univ, Coll Comp Sci & Elect Engn, Changsha 410082, Peoples R China
[4] Hunan Lianzhi Technol Co Ltd, Changsha 410200, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
基金
中国国家自然科学基金;
关键词
Attention mechanism; class incremental learn-ing (CIL); continuous learning; hyperspectral image classification (HSIC); spatial-spectral feature extraction;
D O I
10.1109/TGRS.2023.3333005
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral image classification (HSIC) has attracted widespread attention due to its important application in environment alterations and geophysical disaster monitoring. However, surface cultivation is not static as time passes, which leads to different hyperspectral image (HSI) information collected from the same area at different time periods. Therefore, researchers are currently eager to construct an HSIC model that continuously acquires new classes of data. During the continuous learning process, the model is expected to not only be effective in extracting unique spatial-spectral features of the HSI but also ensure the ability to maintain the old classes' knowledge while learning new data. To achieve this purpose, we propose a method that is based on geometric spatial-spectral feature integration network with class incremental learning (GS2FIN-CIL) framework in continuous learning to make the model adaptable to new classes' data and not overly forgetting the old classes' knowledge during the training process. We conduct extensive experiments with the proposed GS2FIN-CIL method on widely used hyperspectral datasets, including Indian Pines (IP), PaviaU, and Salinas (SA). The experimental results show that our GS2FIN-CIL method can achieve significantly improved results compared to current state-of-the-art class incremental learning (CIL) methods, allowing for efficient adaptation and utilization of spatial-spectral features in processing new classes of HSIs and alleviating the problem of catastrophic forgetting of learned old classes' knowledge. The GS2FIN-CIL method could be successfully applied to the challenge of adding new classes' data in the HSIC task.
引用
收藏
页码:1 / 15
页数:15
相关论文
共 52 条
  • [1] Memory Aware Synapses: Learning What (not) to Forget
    Aljundi, Rahaf
    Babiloni, Francesca
    Elhoseiny, Mohamed
    Rohrbach, Marcus
    Tuytelaars, Tinne
    [J]. COMPUTER VISION - ECCV 2018, PT III, 2018, 11207 : 144 - 161
  • [2] Bai J., 2022, IEEE Trans. Geosci. Remote Sens., V60
  • [3] Bai J., 2022, IEEE Trans. Geosci. Remote Sens., V60
  • [4] Localizing From Classification: Self-Directed Weakly Supervised Object Localization for Remote Sensing Images
    Bai, Jing
    Ren, Junjie
    Xiao, Zhu
    Chen, Zheng
    Gao, Chengxi
    Ali, Talal Ahmed Ali
    Jiao, Licheng
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (12) : 17935 - 17949
  • [5] Achieving Better Category Separability for Hyperspectral Image Classification: A Spatial-Spectral Approach
    Bai, Jing
    Shi, Wei
    Xiao, Zhu
    Ali, Talal Ahmed Ali
    Ye, Fawang
    Jiao, Licheng
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (07) : 9621 - 9635
  • [6] Few-Shot Hyperspectral Image Classification Based on Adaptive Subspaces and Feature Transformation
    Bai, Jing
    Huang, Shaojie
    Xiao, Zhu
    Li, Xianmin
    Zhu, Yongdong
    Regan, Amelia C.
    Jiao, Licheng
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [7] Hyperspectral Image Classification Based on Superpixel Feature Subdivision and Adaptive Graph Structure
    Bai, Jing
    Shi, Wei
    Xiao, Zhu
    Regan, Amelia C.
    Ali, Talal Ahmed Ali
    Zhu, Yongdong
    Zhang, Rui
    Jiao, Licheng
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [8] Two-Stream Spatial-Temporal Graph Convolutional Networks for Driver Drowsiness Detection
    Bai, Jing
    Yu, Wentao
    Xiao, Zhu
    Havyarimana, Vincent
    Regan, Amelia C.
    Jiang, Hongbo
    Jiao, Licheng
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (12) : 13821 - 13833
  • [9] Class Incremental Learning With Few-Shots Based on Linear Programming for Hyperspectral Image Classification
    Bai, Jing
    Yuan, Anran
    Xiao, Zhu
    Zhou, Huaji
    Wang, Dingchen
    Jiang, Hongbo
    Jiao, Licheng
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (06) : 5474 - 5485
  • [10] Geometric Deep Learning Going beyond Euclidean data
    Bronstein, Michael M.
    Bruna, Joan
    LeCun, Yann
    Szlam, Arthur
    Vandergheynst, Pierre
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (04) : 18 - 42