Toward Better Generalization of Cross-Domain Few-Shot Classification in Tibetan Character With Contrastive Learning and Meta Fine-Tuning

被引:0
作者
Bao, Xun [1 ]
Wang, Weilan [1 ,2 ]
Wang, Xiaojuan [1 ,2 ]
Zhao, Guanzhong [1 ]
Li, Huarui [1 ]
Liu, Meiling [1 ]
机构
[1] Northwest Minzu Univ, Key Lab Chinas Ethn Languages & Informat Technol, Minist Educ, Lanzhou 730030, Peoples R China
[2] Northwest Minzu Univ, Sch Math & Comp Sci, Lanzhou 730030, Peoples R China
基金
中国国家自然科学基金;
关键词
Training; Contrastive learning; Data augmentation; Text recognition; Data models; Few shot learning; Feature extraction; Transfer learning; Cross-domain few-shot learning; contrastive learning; meta learning; transfer learning;
D O I
10.1109/ACCESS.2024.3459933
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Few-shot classification aims to classify unseen classes (query instances) with few labeled samples from each class (support instances). However, current few-shot learning methods assume that the training and testing sets obey the same distribution. When there exists a huge domain gap between the training and testing sets, they fail to generalize well across domains. In this work, we tackle the cross-domain few-shot learning (CD-FSL) problem in Tibetan characters from two perspectives. In the meta-training phase, we seamlessly introduce contrastive learning into the episodic training paradigm and apply a data augmentation strategy to seek better feature representations thereby improving the ability to recognize unseen categories. In the meta-finetuning phase, we then integrate the above algorithm into transfer learning and propose a fine-tuning method that generates episodic synthetic query sets to enhance generalization capability across domains. These two stages force the model to overcome the domain shift between training and testing sets. Extensive experiments show that our simple approach allows us to establish competitive results on the well-known few-shot learning dataset Omniglot and state-of-the-art results on our Tibetan character datasets. The code will be publicly available in this repository: https://github.com/coder-bossin/fs-TCR.
引用
收藏
页码:134439 / 134452
页数:14
相关论文
共 50 条
[31]   Fine-Tuning for Few-Shot Image Classification by Multimodal Prototype Regularization [J].
Wu, Qianhao ;
Qi, Jiaxin ;
Zhang, Dong ;
Zhang, Hanwang ;
Tang, Jinhui .
IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 :8543-8556
[32]   Topological Information Aggregation Network for Few-Shot Cross-Domain Hyperspectral Image Classification [J].
Shi, Kai ;
Wang, Wenzhen ;
Liu, Qichao ;
Xiao, Liang .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
[33]   Multi-level relation learning for cross-domain few-shot hyperspectral image classification [J].
Liu, Chun ;
Yang, Longwei ;
Li, Zheng ;
Yang, Wei ;
Han, Zhigang ;
Guo, Jianzhong ;
Yu, Junyong .
APPLIED INTELLIGENCE, 2024, 54 (05) :4392-4410
[34]   Multi-level relation learning for cross-domain few-shot hyperspectral image classification [J].
Chun Liu ;
Longwei Yang ;
Zheng Li ;
Wei Yang ;
Zhigang Han ;
Jianzhong Guo ;
Junyong Yu .
Applied Intelligence, 2024, 54 :4392-4410
[35]   Domain-Invariant Few-Shot Contrastive Learning for Hyperspectral Image Classification [J].
Chen, Wenchen ;
Zhang, Yanmei ;
Chu, Jianping ;
Wang, Xingbo .
APPLIED SCIENCES-BASEL, 2024, 14 (23)
[36]   Causal Meta-Transfer Learning for Cross-Domain Few-Shot Hyperspectral Image Classification [J].
Cheng, Yuhu ;
Zhang, Wei ;
Wang, Haoyu ;
Wang, Xuesong .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
[37]   CoConGAN: Cooperative contrastive learning for few-shot cross-domain heterogeneous face translation [J].
Yinghui Zhang ;
Wansong Hu ;
Bo Sun ;
Jun He ;
Lejun Yu .
Neural Computing and Applications, 2023, 35 :15019-15032
[38]   CoConGAN: Cooperative contrastive learning for few-shot cross-domain heterogeneous face translation [J].
Zhang, Yinghui ;
Hu, Wansong ;
Sun, Bo ;
He, Jun ;
Yu, Lejun .
NEURAL COMPUTING & APPLICATIONS, 2023, 35 (20) :15019-15032
[39]   Relevance equilibrium network for cross-domain few-shot learning [J].
Ji, Zhong ;
Kong, Xiangyu ;
Wang, Xuan ;
Liu, Xiyao .
INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2024, 13 (02)
[40]   Graph Information Aggregation Cross-Domain Few-Shot Learning for Hyperspectral Image Classification [J].
Zhang, Yuxiang ;
Li, Wei ;
Zhang, Mengmeng ;
Wang, Shuai ;
Tao, Ran ;
Du, Qian .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (02) :1912-1925