A Relational Model for One-Shot Classification of Images and Pen Strokes

被引:1
作者
Polis, Arturs [1 ]
Ilin, Alexander [1 ]
机构
[1] Aalto Univ, Espoo, Finland
基金
芬兰科学院;
关键词
One-shot learning; Relational learning; Transformer; Graph network; Omniglot;
D O I
10.1016/j.neucom.2022.06.004
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We show that a deep learning model with built-in relational inductive bias can bring benefits to sample-efficient learning, without relying on extensive data augmentation. Our study shows that excellent results can be achieved with a model in which the relational inductive bias is applied to images, while building an efficient one-shot classifier on top of raw strokes is more challenging. The proposed one-shot classification model performs relational matching of a pair of inputs in the form of local and pairwise attention. Our approach solves with almost perfect accuracy the one-shot image classification Omniglot challenge when combined with a Hungarian matching algorithm and attains competitive results on the same task on characters represented as rotation-augmented strokes.(c) 2022 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY license (http:// creativecommons.org/licenses/by/4.0/).
引用
收藏
页码:1 / 13
页数:13
相关论文
共 36 条
  • [21] Ravi S., 2017, INT C LEARN REPR
  • [22] Santra A, 2017, ADV GEOSPAT TECH, P1, DOI 10.4018/978-1-5225-1814-3
  • [23] SuperGlue: Learning Feature Matching with Graph Neural Networks
    Sarlin, Paul-Edouard
    DeTone, Daniel
    Malisiewicz, Tomasz
    Rabinovich, Andrew
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 4937 - 4946
  • [24] Satorras V. G., 2018, INT C LEARNING REPRE
  • [25] The Graph Neural Network Model
    Scarselli, Franco
    Gori, Marco
    Tsoi, Ah Chung
    Hagenbuchner, Markus
    Monfardini, Gabriele
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2009, 20 (01): : 61 - 80
  • [26] Shyam P, 2017, PR MACH LEARN RES, V70
  • [27] Snell J, 2017, ADV NEUR IN, V30
  • [28] Srivastava N, 2014, J MACH LEARN RES, V15, P1929
  • [29] Learning to Compare: Relation Network for Few-Shot Learning
    Sung, Flood
    Yang, Yongxin
    Zhang, Li
    Xiang, Tao
    Torr, Philip H. S.
    Hospedales, Timothy M.
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 1199 - 1208
  • [30] van der Maaten L., 2011, INT C MACH LEARN, P217