Few-Shot Classification Based on Sparse Dictionary Meta-Learning

被引:1
作者
Jiang, Zuo [1 ]
Wang, Yuan [1 ]
Tang, Yi [1 ]
机构
[1] Yunnan Minzu Univ, Sch Math & Comp Sci, Kunming 650500, Peoples R China
基金
中国国家自然科学基金;
关键词
meta-learning; few-shot learning; sparse dictionary; consistency regularization; ALGORITHM;
D O I
10.3390/math12192992
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
In the field of Meta-Learning, traditional methods for addressing few-shot learning problems often rely on leveraging prior knowledge for rapid adaptation. However, when faced with insufficient data, meta-learning models frequently encounter challenges such as overfitting and limited feature extraction capabilities. To overcome these challenges, an innovative meta-learning approach based on Sparse Dictionary and Consistency Learning (SDCL) is proposed. The distinctive feature of SDCL is the integration of sparse representation and consistency regularization, designed to acquire both broadly applicable general knowledge and task-specific meta-knowledge. Through sparse dictionary learning, SDCL constructs compact and efficient models, enabling the accurate transfer of knowledge from the source domain to the target domain, thereby enhancing the effectiveness of knowledge transfer. Simultaneously, consistency regularization generates synthetic data similar to existing samples, expanding the training dataset and alleviating data scarcity issues. The core advantage of SDCL lies in its ability to preserve key features while ensuring stronger generalization and robustness. Experimental results demonstrate that the proposed meta-learning algorithm significantly improves model performance under limited training data conditions, particularly excelling in complex cross-domain tasks. On average, the algorithm improves accuracy by 3%.
引用
收藏
页数:18
相关论文
共 62 条
[1]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[2]  
Baik S, 2020, ADV NEUR IN, V33
[3]  
Belkin M, 2006, J MACH LEARN RES, V7, P2399
[4]  
Cao H., 2020, IEEE Trans. Neural Netw. Learn. Syst, V31, P4014
[5]  
Chen W., 2019, P INT C LEARN REPR I
[6]  
Chen X., 2022, Pattern Recognit. Lett, V55, P92
[7]  
Chen Y., 2021, IEEE Trans. Pattern Anal. Mach. Intell, P436
[8]   Remote Sensing Image Scene Classification: Benchmark and State of the Art [J].
Cheng, Gong ;
Han, Junwei ;
Lu, Xiaoqiang .
PROCEEDINGS OF THE IEEE, 2017, 105 (10) :1865-1883
[9]   Diffusion maps [J].
Coifman, Ronald R. ;
Lafon, Stephane .
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2006, 21 (01) :5-30
[10]   Image denoising via sparse and redundant representations over learned dictionaries [J].
Elad, Michael ;
Aharon, Michal .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (12) :3736-3745