Graph-based few-shot incremental learning algorithm for unknown class detection

被引:2
作者
Liu, Zijian [1 ]
Wang, Yaning [1 ]
Luo, Yang [1 ]
Luo, Chunbo [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 611731, Peoples R China
关键词
Few-shot learning; Incremental learning; Open set recognition;
D O I
10.1016/j.asoc.2024.111363
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot learning, a promising technique for acquiring new concepts from limited data, assumes that testing samples belong to "unknown classes"and are regarded as new knowledge. However, real-world scenarios introduce uncertainty about the class membership of testing samples. To address this uncertainty, we propose a novel challenge of few-shot incremental unknown class detection, aligning more closely with practical situations. Open set recognition can classify known class samples and reject unknown class samples to mitigate the uncertainty, but it struggles to address the critical limitation of having few available samples. To tackle both uncertainty and limitation, we propose a graph-based few-shot incremental learning algorithm for unknown class detection, which includes four components. First, a feature extractor learns from the base dataset during training and is subsequently fixed for embedding node features from the novel dataset during inference. Then, embedded node features, along with their corresponding prototypes, contribute to graph generation and edge construction. Third, a mixed-rejection strategy is proposed to determine the class membership of testing samples. Finally, a novel class is treated as a new known class, engaging the embedded node features in graph update and edge reconstruction. Evaluation on benchmark datasets with varying structures, including USTC-TFC2016 and miniImageNet datasets, demonstrates that our proposed algorithm outperforms classical open set recognition algorithm in few-shot incremental learning for unknown class detection, which offers promising performance and potential for practical applications in real-world scenarios.
引用
收藏
页数:17
相关论文
共 59 条
[1]   Towards Open Set Deep Networks [J].
Bendale, Abhijit ;
Boult, Terrance E. .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1563-1572
[2]  
Boult TE, 2019, AAAI CONF ARTIF INTE, P9801
[3]   Neural Sign Language Translation [J].
Camgoz, Necati Cihan ;
Hadfield, Simon ;
Koller, Oscar ;
Ney, Hermann ;
Bowden, Richard .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7784-7793
[4]   End-to-End Incremental Learning [J].
Castro, Francisco M. ;
Marin-Jimenez, Manuel J. ;
Guil, Nicolas ;
Schmid, Cordelia ;
Alahari, Karteek .
COMPUTER VISION - ECCV 2018, PT XII, 2018, 11216 :241-257
[5]   MetaFSCEL A Meta-Learning Approach for Few-Shot Class Incremental Learning [J].
Chi, Zhixiang ;
Gu, Li ;
Liu, Huan ;
Wang, Yang ;
Yu, Yuanhao ;
Tang, Jin .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, :14146-14155
[6]  
Finn C, 2017, PR MACH LEARN RES, V70
[7]   Catastrophic forgetting in connectionist networks [J].
French, RM .
TRENDS IN COGNITIVE SCIENCES, 1999, 3 (04) :128-135
[8]   An empirical comparison of botnet detection methods [J].
Garcia, S. ;
Grill, M. ;
Stiborek, J. ;
Zunino, A. .
COMPUTERS & SECURITY, 2014, 45 :100-123
[9]   A survey on deep learning techniques for image and video semantic segmentation [J].
Garcia-Garcia, Alberto ;
Orts-Escolano, Sergio ;
Oprea, Sergiu ;
Villena-Martinez, Victor ;
Martinez-Gonzalez, Pablo ;
Garcia-Rodriguez, Jose .
APPLIED SOFT COMPUTING, 2018, 70 :41-65
[10]   Recent Advances in Open Set Recognition: A Survey [J].
Geng, Chuanxing ;
Huang, Sheng-Jun ;
Chen, Songcan .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (10) :3614-3631