Breadcrumbs: Adversarial Class-Balanced Sampling for Long-Tailed Recognition

被引:6
作者
Liu, Bo [1 ]
Li, Haoxiang [1 ]
Kang, Hao [1 ]
Hua, Gang [1 ]
Vasconcelos, Nuno [2 ]
机构
[1] Wormpex AI Res, Bellevue, WA USA
[2] Univ Calif San Diego, San Diego, CA 92103 USA
来源
COMPUTER VISION, ECCV 2022, PT XXIV | 2022年 / 13684卷
基金
国家重点研发计划;
关键词
D O I
10.1007/978-3-031-20053-3_37
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The problem of long-tailed recognition, where the number of examples per class is highly unbalanced, is considered. While training with class-balanced sampling has been shown effective for this problem, it is known to over-fit to few-shot classes. It is hypothesized that this is due to the repeated sampling of examples and can be addressed by feature space augmentation. A new feature augmentation strategy, EMANATE, based on back-tracking of features across epochs during training, is proposed. It is shown that, unlike class-balanced sampling, this is an adversarial augmentation strategy. A new sampling procedure, Breadcrumb, is then introduced to implement adversarial class-balanced sampling without extra computation. Experiments on three popular long-tailed recognition datasets show that Breadcrumb training produces classifiers that outperform existing solutions to the problem. Code: https://github.com/ BoLiu-SVCL/Breadcrumbs.
引用
收藏
页码:637 / 653
页数:17
相关论文
共 40 条
  • [1] Cao KD, 2019, ADV NEUR IN, V32
  • [2] Image Deformation Meta-Networks for One-Shot Learning
    Chen, Zitian
    Fu, Yanwei
    Wang, Yu-Xiong
    Ma, Lin
    Liu, Wei
    Hebert, Martial
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 8672 - 8681
  • [3] Class-Balanced Loss Based on Effective Number of Samples
    Cui, Yin
    Jia, Menglin
    Lin, Tsung-Yi
    Song, Yang
    Belongie, Serge
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9260 - 9269
  • [4] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
  • [5] Multi-modal Cycle-Consistent Generalized Zero-Shot Learning
    Felix, Rafael
    Kumar, B. G. Vijay
    Reid, Ian
    Carneiro, Gustavo
    [J]. COMPUTER VISION - ECCV 2018, PT VI, 2018, 11210 : 21 - 37
  • [6] Finn C, 2018, ADV NEUR IN, V31
  • [7] Finn C, 2017, PR MACH LEARN RES, V70
  • [8] Dynamic Few-Shot Visual Learning without Forgetting
    Gidaris, Spyros
    Komodakis, Nikos
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 4367 - 4375
  • [9] Low-shot Visual Recognition by Shrinking and Hallucinating Features
    Hariharan, Bharath
    Girshick, Ross
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 3037 - 3046
  • [10] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778