Feature alignment via mutual mapping for few-shot fine-grained visual classification

被引:1
|
作者
Wu, Qin [1 ]
Song, Tingting [1 ]
Fan, Shengnan [1 ]
Chen, Zeda [1 ]
Jin, Kelei [1 ]
Zhou, Haojie [1 ]
机构
[1] Jiangnan Univ, Sch Artificial Intelligence & Comp Sci, Wuxi 214122, Peoples R China
关键词
Mutual mapping; Few-shot learning; Feature alignment; Self-reconstruction; Fine-grained visual classification; NETWORKS;
D O I
10.1016/j.imavis.2024.105032
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot fine-grained visual classification aims to identify fine-grained concepts with very few samples, which is widely used in many fields, such as the classification of different species of birds in biological research, and the identification of car models in traffic monitoring. Compared with the common few-shot classification task, it encounters difficulties due to significant variations within each class and small gaps between different categories. To address such problems, previous studies primarily project support samples into the space of query samples and employ metric learning to classify query images into their respective categories. However, we observe that such methods are not effective in resolving inter-class variations. To overcome this limitation, we propose a new feature alignment method based on mutual mapping, which simultaneously considers the discriminative features of new samples and classes. Specifically, besides projecting support samples into the space of query samples for reducing intra-class variations, we also project query samples into the space of support samples to increase interclass variations. Furthermore, a direct position self-reconstruction module is proposed to utilize the location information of objects and obtain more discriminative features. Extensive experiments on four fine-grained benchmarks demonstrate that our approach is competitive when compared with other state-of-the-art methods, in both 1-shot and 5-shot settings. In the case of 5-shot, our method achieved the best performance on all four datasets, with 92.11%, 85.31%, 96.09%, and 94.64% accuracies on CUB-200-2011, Stanford Dogs, Stanford Cars, and Aircaft, respectively.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Variational Feature Disentangling for Fine-Grained Few-Shot Classification
    Xu, Jingyi
    Le, Hieu
    Huang, Mingzhen
    Athar, ShahRukh
    Samaras, Dimitris
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 8792 - 8801
  • [2] Few-Shot Fine-Grained Image Classification via GNN
    Zhou, Xiangyu
    Zhang, Yuhui
    Wei, Qianru
    SENSORS, 2022, 22 (19)
  • [3] Feature fusion network based on few-shot fine-grained classification
    Yang, Yajie
    Feng, Yuxuan
    Zhu, Li
    Fu, Haitao
    Pan, Xin
    Jin, Chenlei
    FRONTIERS IN NEUROROBOTICS, 2023, 17
  • [4] Dual adaptive local semantic alignment for few-shot fine-grained classification
    Song, Wei
    Yang, Kaili
    VISUAL COMPUTER, 2025, 41 (04): : 2923 - 2937
  • [5] An Unbiased Feature Estimation Network for Few-Shot Fine-Grained Image Classification
    Wang, Jiale
    Lu, Jin
    Yang, Junpo
    Wang, Meijia
    Zhang, Weichuan
    SENSORS, 2024, 24 (23)
  • [6] Fine-Grained Few-Shot Image Classification Based on Feature Dual Reconstruction
    Liu, Shudong
    Zhong, Wenlong
    Guo, Furong
    Cong, Jia
    Gu, Boyu
    ELECTRONICS, 2024, 13 (14)
  • [7] Variational Feature Imitation Conditioned on Visual Descriptions for Few-Shot Fine-Grained Recognition
    Lu, Xin
    Pan, Yixuan
    Cao, Yichao
    Zhou, Xin
    Lu, Xiaobo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (03) : 2215 - 2229
  • [8] Few-Shot Fine-Grained Image Classification: A Comprehensive Review
    Ren, Jie
    Li, Changmiao
    An, Yaohui
    Zhang, Weichuan
    Sun, Changming
    AI, 2024, 5 (01) : 405 - 425
  • [9] Task Discrepancy Maximization for Fine-grained Few-Shot Classification
    Lee, SuBeen
    Moon, WonJun
    Heo, Jae-Pil
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5321 - 5330
  • [10] Few-shot fine-grained classification with Spatial Attentive Comparison
    Ruan, Xiaoqian
    Lin, Guosheng
    Long, Cheng
    Lu, Shengli
    KNOWLEDGE-BASED SYSTEMS, 2021, 218