Word Embedding Distribution Propagation Graph Network for Few-Shot Learning

被引:0
作者
Zhu, Chaoran [1 ]
Wang, Ling [1 ]
Han, Cheng [1 ]
机构
[1] Changchun Univ Sci & Technol, Coll Comp Sci & Technol, Changchun 130022, Peoples R China
基金
美国国家科学基金会;
关键词
few-shot learning; graph neural network; semantic information; attention mechanism; Mahalanobis distance; FReLU;
D O I
10.3390/s22072648
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Few-shot learning (FSL) is of great significance to the field of machine learning. The ability to learn and generalize using a small number of samples is an obvious distinction between artificial intelligence and humans. In the FSL domain, most graph neural networks (GNNs) focus on transferring labeled sample information to an unlabeled query sample, ignoring the important role of semantic information during the classification process. Our proposed method embeds semantic information of classes into a GNN, creating a word embedding distribution propagation graph network (WPGN) for FSL. We merge the attention mechanism with our backbone network, use the Mahalanobis distance to calculate the similarity of classes, select the Funnel ReLU (FReLU) function as the activation function of the Transform layer, and update the point graph and word embedding distribution graph. In extensive experiments on FSL benchmarks, compared with the baseline model, the accuracy of the WPGN on the 5-way-1/2/5 shot tasks increased by 9.03, 4.56, and 4.15%, respectively.
引用
收藏
页数:20
相关论文
共 33 条
  • [1] Few-Shot Learning with a Novel Voronoi Tessellation-Based Image Augmentation Method for Facial Palsy Detection
    Abayomi-Alli, Olusola Oluwakemi
    Damasevicius, Robertas
    Maskeliunas, Rytis
    Misra, Sanjay
    [J]. ELECTRONICS, 2021, 10 (08)
  • [2] Bateni P, 2020, PROC CVPR IEEE, P14481, DOI 10.1109/CVPR42600.2020.01450
  • [3] Bertinetto L., 2019, P INT C LEARN REPR
  • [4] Fine-Grained Representation Learning and Recognition by Exploiting Hierarchical Semantic Embedding
    Chen, Tianshui
    Wu, Wenxi
    Gao, Yuefang
    Dong, Le
    Luo, Xiaonan
    Lin, Liang
    [J]. PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 2023 - 2031
  • [5] Chen W.-Y., 2019, INT C LEARN REPR, P1
  • [6] Multi-Level Semantic Feature Augmentation for One-Shot Learning
    Chen, Zitian
    Fu, Yanwei
    Zhang, Yinda
    Jiang, Yu-Gang
    Xue, Xiangyang
    Sigal, Leonid
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (09) : 4594 - 4605
  • [7] Finn C, 2017, PR MACH LEARN RES, V70
  • [8] Garcia Victor., 2017, ARXIV171104043
  • [9] Generating Classification Weights with GNN Denoising Autoencoders for Few-Shot Learning
    Gidaris, Spyros
    Komodakis, Nikos
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 21 - 30
  • [10] Higashi R., 2020, IEICE TECH REP, V120, P133