Toward Better Generalization of Cross-Domain Few-Shot Classification in Tibetan Character With Contrastive Learning and Meta Fine-Tuning

被引:0
作者
Bao, Xun [1 ]
Wang, Weilan [1 ,2 ]
Wang, Xiaojuan [1 ,2 ]
Zhao, Guanzhong [1 ]
Li, Huarui [1 ]
Liu, Meiling [1 ]
机构
[1] Northwest Minzu Univ, Key Lab Chinas Ethn Languages & Informat Technol, Minist Educ, Lanzhou 730030, Peoples R China
[2] Northwest Minzu Univ, Sch Math & Comp Sci, Lanzhou 730030, Peoples R China
基金
中国国家自然科学基金;
关键词
Training; Contrastive learning; Data augmentation; Text recognition; Data models; Few shot learning; Feature extraction; Transfer learning; Cross-domain few-shot learning; contrastive learning; meta learning; transfer learning;
D O I
10.1109/ACCESS.2024.3459933
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Few-shot classification aims to classify unseen classes (query instances) with few labeled samples from each class (support instances). However, current few-shot learning methods assume that the training and testing sets obey the same distribution. When there exists a huge domain gap between the training and testing sets, they fail to generalize well across domains. In this work, we tackle the cross-domain few-shot learning (CD-FSL) problem in Tibetan characters from two perspectives. In the meta-training phase, we seamlessly introduce contrastive learning into the episodic training paradigm and apply a data augmentation strategy to seek better feature representations thereby improving the ability to recognize unseen categories. In the meta-finetuning phase, we then integrate the above algorithm into transfer learning and propose a fine-tuning method that generates episodic synthetic query sets to enhance generalization capability across domains. These two stages force the model to overcome the domain shift between training and testing sets. Extensive experiments show that our simple approach allows us to establish competitive results on the well-known few-shot learning dataset Omniglot and state-of-the-art results on our Tibetan character datasets. The code will be publicly available in this repository: https://github.com/coder-bossin/fs-TCR.
引用
收藏
页码:134439 / 134452
页数:14
相关论文
共 50 条
[41]   Knowledge transduction for cross-domain few-shot learning [J].
Li, Pengfang ;
Liu, Fang ;
Jiao, Licheng ;
Li, Shuo ;
Li, Lingling ;
Liu, Xu ;
Huang, Xinyan .
PATTERN RECOGNITION, 2023, 141
[42]   An Analysis of LLM Fine-Tuning and Few-Shot Learning for Flaky Test Detection and Classification [J].
More, Riddhi ;
Bradbury, Jeremy S. .
2025 IEEE CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION, ICST, 2025, :349-359
[43]   Cross-Domain PolSAR Image Classification Using Complex-Valued Few-Shot Learning Network [J].
Cao, Yice ;
Wu, Zhenhua ;
Chen, Jie ;
Huang, Zhixiang ;
Yang, Lixia .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2025, 61 (02) :2450-2465
[44]   DUAL GRAPH CROSS-DOMAIN FEW-SHOT LEARNING FOR HYPERSPECTRAL IMAGE CLASSIFICATION [J].
Zhang, Yuxiang ;
Li, Wei ;
Zhang, Mengmeng ;
Tao, Ran .
2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, :3573-3577
[45]   Experiments in Cross-domain Few-shot Learning for Image Classification: Extended Abstract [J].
Wang, Hongyu ;
Fraser, Huon ;
Gouk, Henry ;
Frank, Eibe ;
Pfahringer, Bernhard ;
Mayo, Michael ;
Holmes, Geoff .
ECMLPKDD WORKSHOP ON META-KNOWLEDGE TRANSFER, VOL 191, 2022, 191 :81-83
[46]   Generalized Meta-FDMixup: Cross-Domain Few-Shot Learning Guided by Labeled Target Data [J].
Fu, Yuqian ;
Fu, Yanwei ;
Chen, Jingjing ;
Jiang, Yu-Gang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :7078-7090
[47]   DIVERSIFIED TASK AUGMENTATION WITH REDUNDANCY REDUCTION FOR CROSS-DOMAIN FEW-SHOT LEARNING [J].
Yue, Ling ;
Feng, Lin ;
Shuai, Qiuping ;
Xu, Lingxiao ;
Li, Zihao .
2024 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2024, :631-637
[48]   Dual Attention Relation Network With Fine-Tuning for Few-Shot EEG Motor Imagery Classification [J].
An, Sion ;
Kim, Soopil ;
Chikontwe, Philip ;
Park, Sang Hyun .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (11) :15479-15493
[49]   Contrastive Meta-Learning for Few-shot Node Classification [J].
Wang, Song ;
Tan, Zhen ;
Liu, Huan ;
Li, Jundong .
PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, :2386-2397
[50]   HybridPrompt: Domain-Aware Prompting for Cross-Domain Few-Shot Learning [J].
Wu, Jiamin ;
Zhang, Tianzhu ;
Zhang, Yongdong .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (12) :5681-5697