The feature generator of hard negative samples for fine-grained image recognition

被引:8
作者
Kim, Taehung [1 ]
Hong, Kibeom [1 ]
Byun, Hyeran [1 ]
机构
[1] Yonsei Univ, Dept Comp Sci, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Fine-grained image recognition; Metric learning; Hard negative sample; Feature generation; Deep neural networks;
D O I
10.1016/j.neucom.2020.10.032
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The key to solving the fine-grained image recognition is exploring more discriminative features for capturing tiny hints. In particular, the triplet objective function fits well with the fine-grained image recognition task because they capture the semantic similarity between images. However, triplet loss needs many pairs of tuples with hard negative samples, and it takes too much cost. To alleviate this problem, we propose a new framework that generates features of the hard negative samples. The proposed framework consists of three stages: learning part-wise features, enriching refined hard negative samples, and fine-grained image recognition. Our proposed method has achieved state-of-the-art performance in CUB 200-2011, Stanford Cars, FGVC-Aircraft, and DeepFashion datasets. Also, our extensive experiments demonstrate that each stage has a good effect on the final goal. (c) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:374 / 382
页数:9
相关论文
共 50 条
  • [41] RAMS-Trans: Recurrent Attention Multi-scale Transformer for Fine-grained Image Recognition
    Hu, Yunqing
    Jin, Xuan
    Zhang, Yin
    Hong, Haiwen
    Zhang, Jingfeng
    He, Yuan
    Xue, Hui
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 4239 - 4248
  • [42] Subtler mixed attention network on fine-grained image classification
    Liu, Chao
    Huang, Lei
    Wei, Zhiqiang
    Zhang, Wenfeng
    APPLIED INTELLIGENCE, 2021, 51 (11) : 7903 - 7916
  • [43] Discriminative information restoration and extraction for weakly supervised low-resolution fine-grained image recognition
    Yan, Tiantian
    Shi, Jian
    Li, Haojie
    Luo, Zhongxuan
    Wang, Zhihui
    PATTERN RECOGNITION, 2022, 127
  • [44] Subtler mixed attention network on fine-grained image classification
    Chao Liu
    Lei Huang
    Zhiqiang Wei
    Wenfeng Zhang
    Applied Intelligence, 2021, 51 : 7903 - 7916
  • [45] Spatial-aware collaborative region mining for fine-grained recognition
    Weiwei Yang
    Jian Yin
    Multimedia Tools and Applications, 2024, 83 (9) : 25741 - 25767
  • [46] INCORPORATING INTRA-CLASS VARIANCE TO FINE-GRAINED VISUAL RECOGNITION
    Bai, Yan
    Gao, Feng
    Lou, Yihang
    Wang, Shiqi
    Huang, Tiejun
    Duan, Ling-Yu
    2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 1452 - 1457
  • [47] Fine-grained action recognition using multi-view attentions
    Yisheng Zhu
    Guangcan Liu
    The Visual Computer, 2020, 36 : 1771 - 1781
  • [48] Fine-Grained Representation Learning and Recognition by Exploiting Hierarchical Semantic Embedding
    Chen, Tianshui
    Wu, Wenxi
    Gao, Yuefang
    Dong, Le
    Luo, Xiaonan
    Lin, Liang
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 2023 - 2031
  • [49] ZoomViT: an observation behavior-based fine-grained recognition scheme
    Ma Z.
    Yang Y.
    Wang H.
    Huang L.
    Wei Z.
    Neural Computing and Applications, 2024, 36 (21) : 12775 - 12789
  • [50] Fine-grained action recognition using multi-view attentions
    Zhu, Yisheng
    Liu, Guangcan
    VISUAL COMPUTER, 2020, 36 (09) : 1771 - 1781