Developing a Plug-and-Play Meta-Detector for Few-Shot Fine-Grained Image Categorization

被引:0
作者
Dong, Ning [1 ,2 ]
Jiao, Ziyun [3 ]
Shen, Yang [1 ,4 ]
Guo, Xinnian [1 ,2 ,5 ]
机构
[1] Suqian Univ, Sch Informat Engn, Suqian 223800, Peoples R China
[2] Suqian Univ, Suqian Key Lab Visual Inspection & Intelligent Con, Suqian 223800, Peoples R China
[3] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 611731, Peoples R China
[4] Suqian Univ, Ind Res Inst, Suqian 223800, Peoples R China
[5] Suqian Univ, Jiangsu Prov Engn Res Ctr Smart Poultry Farming &, Suqian 223800, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Task analysis; Training; Image categorization; Few shot learning; Metalearning; Image classification; Feature extraction; Annotations; Few-shot; fine-grained categorization; plug-and-play; meta-detector; NETWORK;
D O I
10.1109/ACCESS.2024.3438944
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Few-shot fine-grained (FSFG) categorization aims to classify new, fine-grained concepts using limited annotated data for each class. It requires a model capable of learning subtle, distinguishable features from similar classes. An intuitive approach is to identify several discriminative parts based on the input image and represent it using these localized parts. It is interpretable since the parts obtained and combined can be seen as the way humans learn about new concepts. Therefore, we propose a straightforward and efficient module for the FSFG task by emphasizing the importance of information from discriminative parts. Specifically, we design a plug-and-play meta-detector based on object detection models, which identifies the positions of distinguishable parts in fine-grained images. With the positions of objects and semantic parts identified, we can extract richer features to enhance few-shot results. Extensive experiments on five fine-grained datasets demonstrate that our approach is applicable to various few-shot backbones and significantly improves accuracy without adding extra parameters. More importantly, compared to other variants on the same base few-shot network, the meta-detector module significantly outperforms them, further demonstrating its effectiveness.
引用
收藏
页码:109416 / 109426
页数:11
相关论文
共 64 条
  • [1] Bateni P, 2020, PROC CVPR IEEE, P14481, DOI 10.1109/CVPR42600.2020.01450
  • [2] SR-GNN: Spatial Relation-Aware Graph Neural Network for Fine-Grained Image Categorization
    Bera, Asish
    Wharton, Zachary
    Liu, Yonghuai
    Bessis, Nik
    Behera, Ardhendu
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 6017 - 6031
  • [3] Holistic Prototype Activation for Few-Shot Segmentation
    Cheng, Gong
    Lang, Chunbo
    Han, Junwei
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (04) : 4650 - 4666
  • [4] AP-CNN: Weakly Supervised Attention Pyramid Convolutional Neural Network for Fine-Grained Visual Classification
    Ding, Yifeng
    Ma, Zhanyu
    Wen, Shaoguo
    Xie, Jiyang
    Chang, Dongliang
    Si, Zhongwei
    Wu, Ming
    Ling, Haibin
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 2826 - 2836
  • [5] Finn C, 2017, PR MACH LEARN RES, V70
  • [6] Boosting Few-Shot Visual Learning with Self-Supervision
    Gidaris, Spyros
    Bursuc, Andrei
    Komodakis, Nikos
    Perez, Patrick
    Cord, Matthieu
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 8058 - 8067
  • [7] Bin similarity-based domain adaptation for fine-grained image classification
    Han, Tianyu
    Zhang, Lifeng
    Jia, Shixiang
    [J]. INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (03) : 2319 - 2334
  • [8] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [9] Low-Rank Pairwise Alignment Bilinear Network For Few-Shot Fine-Grained Image Classification
    Huang, Huaxi
    Zhang, Junjie
    Zhang, Jian
    Xu, Jingsong
    Wu, Qiang
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 1666 - 1680
  • [10] Task Agnostic Meta-Learning for Few-Shot Learning
    Jamal, Muhammad Abdullah
    Qi, Guo-Jun
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11711 - 11719