Word Embedding Distribution Propagation Graph Network for Few-Shot Learning

被引:0
作者
Zhu, Chaoran [1 ]
Wang, Ling [1 ]
Han, Cheng [1 ]
机构
[1] Changchun Univ Sci & Technol, Coll Comp Sci & Technol, Changchun 130022, Peoples R China
基金
美国国家科学基金会;
关键词
few-shot learning; graph neural network; semantic information; attention mechanism; Mahalanobis distance; FReLU;
D O I
10.3390/s22072648
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Few-shot learning (FSL) is of great significance to the field of machine learning. The ability to learn and generalize using a small number of samples is an obvious distinction between artificial intelligence and humans. In the FSL domain, most graph neural networks (GNNs) focus on transferring labeled sample information to an unlabeled query sample, ignoring the important role of semantic information during the classification process. Our proposed method embeds semantic information of classes into a GNN, creating a word embedding distribution propagation graph network (WPGN) for FSL. We merge the attention mechanism with our backbone network, use the Mahalanobis distance to calculate the similarity of classes, select the Funnel ReLU (FReLU) function as the activation function of the Transform layer, and update the point graph and word embedding distribution graph. In extensive experiments on FSL benchmarks, compared with the baseline model, the accuracy of the WPGN on the 5-way-1/2/5 shot tasks increased by 9.03, 4.56, and 4.15%, respectively.
引用
收藏
页数:20
相关论文
共 33 条
  • [11] Task Agnostic Meta-Learning for Few-Shot Learning
    Jamal, Muhammad Abdullah
    Qi, Guo-Jun
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11711 - 11719
  • [12] Jiang Zihang, 2020, ARXIV200802465, P2020
  • [13] Edge-Labeling Graph Neural Network for Few-shot Learning
    Kim, Jongmin
    Kim, Taesup
    Kim, Sungwoong
    Yoo, Chang D.
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11 - 20
  • [14] Koch G, 2015, ICML DEEP LEARNING W, P2
  • [15] Li AX, 2020, PROC CVPR IEEE, P12573, DOI 10.1109/CVPR42600.2020.01259
  • [16] Large-Scale Few-Shot Learning: Knowledge Transfer With Class Hierarchy
    Li, Aoxue
    Luo, Tiange
    Lu, Zhiwu
    Xiang, Tao
    Wang, Liwei
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 7205 - 7213
  • [17] WORDNET - A LEXICAL DATABASE FOR ENGLISH
    MILLER, GA
    [J]. COMMUNICATIONS OF THE ACM, 1995, 38 (11) : 39 - 41
  • [18] Multimodal Few-Shot Learning for Gait Recognition
    Moon, Jucheol
    Nhat Anh Le
    Minaya, Nelson Hebert
    Choi, Sang-Il
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (21): : 1 - 15
  • [19] Ningning Ma, 2020, Computer Vision - ECCV 2020 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12356), P351, DOI 10.1007/978-3-030-58621-8_21
  • [20] Ohkuma T., 2020, P 2020 IEICE 120 IEI