Posture-guided part learning for fine-grained image categorization

被引:1
作者
Song, Wei [1 ]
Chen, Dongmei [1 ]
机构
[1] Jiangnan Univ, Sch Artificial Intelligence & Comp Sci, Wuxi, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
fine-grained image classification; feature enhancement; posture modeling; feature fusion; CLASSIFICATION; NETWORK;
D O I
10.1117/1.JEI.33.3.033013
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
. The challenge in fine-grained image classification tasks lies in distinguishing subtle differences among fine-grained images. Existing image classification methods often only explore information in isolated regions without considering the relationships among these parts, resulting in incomplete information and a tendency to focus on individual parts. Posture information is hidden among these parts, so it plays a crucial role in differentiating among similar categories. Therefore, we propose a posture-guided part learning framework capable of extracting hidden posture information among regions. In this framework, the dual-branch feature enhancement module (DBFEM) highlights discriminative information related to fine-grained objects by extracting attention information between the feature space and channels. The part selection module selects multiple discriminative parts based on the attention information from DBFEM. Building upon this, the posture feature fusion module extracts semantic features from discriminative parts and constructs posture features among different parts based on these semantic features. Finally, by fusing part semantic features with posture features, a comprehensive representation of fine-grained object features is obtained, aiding in differentiating among similar categories. Extensive evaluations on three benchmark datasets demonstrate the competitiveness of the proposed framework compared with state-of-the-art methods.
引用
收藏
页数:19
相关论文
共 55 条
  • [1] Behera A, 2021, AAAI CONF ARTIF INTE, V35, P929
  • [2] SR-GNN: Spatial Relation-Aware Graph Neural Network for Fine-Grained Image Categorization
    Bera, Asish
    Wharton, Zachary
    Liu, Yonghuai
    Bessis, Nik
    Behera, Ardhendu
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 6017 - 6031
  • [3] Branson Steve, 2014, CoRR abs/1406.2952
  • [4] The Devil is in the Channels: Mutual-Channel Loss for Fine-Grained Image Classification
    Chang, Dongliang
    Ding, Yifeng
    Xie, Jiyang
    Bhunia, Ayan Kumar
    Li, Xiaoxu
    Ma, Zhanyu
    Wu, Ming
    Guo, Jun
    Song, Yi-Zhe
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 4683 - 4695
  • [5] FET-FGVC: Feature-enhanced transformer for fine-grained visual classification
    Chen, Huazhen
    Zhang, Haimiao
    Liu, Chang
    An, Jianpeng
    Gao, Zhongke
    Qiu, Jun
    [J]. PATTERN RECOGNITION, 2024, 149
  • [6] Destruction and Construction Learning for Fine-grained Image Recognition
    Chen, Yue
    Bai, Yalong
    Zhang, Wei
    Mei, Tao
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 5152 - 5161
  • [7] AP-CNN: Weakly Supervised Attention Pyramid Convolutional Neural Network for Fine-Grained Visual Classification
    Ding, Yifeng
    Ma, Zhanyu
    Wen, Shaoguo
    Xie, Jiyang
    Chang, Dongliang
    Si, Zhongwei
    Wu, Ming
    Ling, Haibin
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 2826 - 2836
  • [8] Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
  • [9] Progressive Learning of Category-Consistent Multi-Granularity Features for Fine-Grained Visual Classification
    Du, Ruoyi
    Xie, Jiyang
    Ma, Zhanyu
    Chang, Dongliang
    Song, Yi-Zhe
    Guo, Jun
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (12) : 9521 - 9535
  • [10] Dermatologist-level classification of skin cancer with deep neural networks
    Esteva, Andre
    Kuprel, Brett
    Novoa, Roberto A.
    Ko, Justin
    Swetter, Susan M.
    Blau, Helen M.
    Thrun, Sebastian
    [J]. NATURE, 2017, 542 (7639) : 115 - +