Semi-supervised few-shot class-incremental learning based on dynamic topology evolution

被引:0
作者
Han, Wenqi [1 ]
Huang, Kai [1 ]
Geng, Jie [1 ]
Jiang, Wen [1 ]
机构
[1] Northwestern Polytech Univ, Sch Elect & Informat, Xian 710072, Peoples R China
基金
中国博士后科学基金;
关键词
Few-shot learning; Semi-supervised learning; Class-incremental learning; Aerial image scene classification;
D O I
10.1016/j.engappai.2024.108528
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Incremental learning of new classes is crucial to developing real-world artificial intelligence systems. However, in some cases, we can only use a limited number of images to train the incremental model due to the difficulty of obtaining them. Few-shot class-incremental learning (FSCIL) is a new paradigm of incremental learning, which continually learns new concepts from a few examples. This setup can quickly lead to catastrophic forgetting and overfitting problems, severely affecting model performance. To address these problems, we propose a dynamic topological evolution (DTE) model that unifies knowledge of old and new categories. In this work, we focus on a novel semi-supervised few-shot class-incremental learning (SSFSCIL) to incrementally learn new categories with a limited number of labeled samples and a large number of unlabeled samples. In detail, we use the Voronoi polygon criterion to divide the feature space and construct a Hebbian graph to represent topological relationships between classes. Then, the corresponding k-nearest neighbor subgraph is constructed for the new incremental task, and label propagation of graph nodes is carried out on the unlabeled set to generate the corresponding pseudo labels. Finally, the new category knowledge is evolved into the actual category knowledge by integrating the Hebbian graph and the k-nearest neighbor subgraph obtained in the new incremental task. Extensive experiments on the mini-ImageNet and CIFAR100 datasets show that the accuracy of the DTE outperforms the baseline and improves by 1.41% and 1.13% on the last incremental task. Furthermore, our methodology achieved a 35.6% time improvement compared to full-supervised methods on the CIFAR100 dataset. In addition to the experiments on the two datasets mentioned above, the validation of our proposed DTE model extends to the engineering application domain of the RESICS-45 aircraft image scene classification dataset.
引用
收藏
页数:14
相关论文
共 63 条
[1]   End-to-End Incremental Learning [J].
Castro, Francisco M. ;
Marin-Jimenez, Manuel J. ;
Guil, Nicolas ;
Schmid, Cordelia ;
Alahari, Karteek .
COMPUTER VISION - ECCV 2018, PT XII, 2018, 11216 :241-257
[2]   When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs [J].
Cheng, Gong ;
Yang, Ceyuan ;
Yao, Xiwen ;
Guo, Lei ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (05) :2811-2821
[3]   Semantic-aware Knowledge Distillation for Few-Shot Class-Incremental Learning [J].
Cheraghian, Ali ;
Rahman, Shafin ;
Fang, Pengfei ;
Roy, Soumava Kumar ;
Petersson, Lars ;
Harandi, Mehrtash .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :2534-2543
[4]  
Dong SL, 2021, AAAI CONF ARTIF INTE, V35, P1255
[5]   Traditional to transfer learning progression on scene text detection and recognition: a survey [J].
Gupta, Neeraj ;
Jalal, Anand Singh .
ARTIFICIAL INTELLIGENCE REVIEW, 2022, 55 (04) :3457-3502
[6]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[7]   Leveraging the meta-embedding for text classification in a resource-constrained language [J].
Hossain, Md. Rajib ;
Hoque, Mohammed Moshiul ;
Siddique, Nazmul .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 124
[8]   Learning a Unified Classifier Incrementally via Rebalancing [J].
Hou, Saihui ;
Pan, Xinyu ;
Loy, Chen Change ;
Wang, Zilei ;
Lin, Dahua .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :831-839
[9]   Pseudo-loss Confidence Metric for Semi-supervised Few-shot Learning [J].
Huang, Kai ;
Geng, Jie ;
Jiang, Wen ;
Deng, Xinyang ;
Xu, Zhe .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :8651-8660
[10]   Label Propagation for Deep Semi-supervised Learning [J].
Iscen, Ahmet ;
Tolias, Giorgos ;
Avrithis, Yannis ;
Chum, Ondrej .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :5065-5074