Angular Isotonic Loss Guided Multi-Layer Integration for Few-Shot Fine-Grained Image Classification

被引:5
作者
Zhao, Li-Jun [1 ]
Chen, Zhen-Duo [1 ]
Ma, Zhen-Xiang [1 ]
Luo, Xin [1 ]
Xu, Xin-Shun [1 ,2 ]
机构
[1] Shandong Univ, Sch Software, Jinan 250101, Peoples R China
[2] Quan Cheng Lab, Jinan 250103, Peoples R China
基金
中国国家自然科学基金;
关键词
Prototypes; Artificial intelligence; Feature extraction; Training; Vectors; Task analysis; Image classification; Fine-grained image classification; few-shot learning; metric learning; deep neural network; NETWORK; ALIGNMENT;
D O I
10.1109/TIP.2024.3411474
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent research on few-shot fine-grained image classification (FSFG) has predominantly focused on extracting discriminative features. The limited attention paid to the role of loss functions has resulted in weaker preservation of similarity relationships between query and support instances, thereby potentially limiting the performance of FSFG. In this regard, we analyze the limitations of widely adopted cross-entropy loss and introduce a novel Angular ISotonic (AIS) loss. The AIS loss introduces an angular margin to constrain the prototypes to maintain a certain distance from a pre-set threshold. It guides the model to converge more stably, learn clearer boundaries among highly similar classes, and achieve higher accuracy faster with limited instances. Moreover, to better accommodate the feature requirements of the AIS loss and fully exploit its potential in FSFG, we propose a Multi-Layer Integration (MLI) network that captures object features from multiple perspectives to provide more comprehensive and informative representations of the input images. Extensive experiments demonstrate the effectiveness of our proposed method on four standard fine-grained benchmarks. Codes are available at: https://github.com/Legenddddd/AIS-MLI.
引用
收藏
页码:3778 / 3792
页数:15
相关论文
共 85 条
[1]   Matching Feature Sets for Few-Shot Image Classification [J].
Afrasiyabi, Arman ;
Larochelle, Hugo ;
Lalonde, Jean-Francois ;
Gagne, Christian .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, :9004-9014
[2]   Mixture-based Feature Space Learning for Few-shot Image Classification [J].
Afrasiyabi, Arman ;
Lalonde, Jean-Francois ;
Gagne, Christian .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :9021-9031
[3]   Associative Alignment for Few-Shot Image Classification [J].
Afrasiyabi, Arman ;
Lalonde, Jean-Francois ;
Gagne, Christian .
COMPUTER VISION - ECCV 2020, PT V, 2020, 12350 :18-35
[4]   Learning to Compare Relation: Semantic Alignment for Few-Shot Learning [J].
Cao, Congqi ;
Zhang, Yanning .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :1462-1474
[5]   The Devil is in the Channels: Mutual-Channel Loss for Fine-Grained Image Classification [J].
Chang, Dongliang ;
Ding, Yifeng ;
Xie, Jiyang ;
Bhunia, Ayan Kumar ;
Li, Xiaoxu ;
Ma, Zhanyu ;
Wu, Ming ;
Guo, Jun ;
Song, Yi-Zhe .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :4683-4695
[6]  
Chen W., 2019, 7 INT C LEARN REPR I
[7]  
Chen YB, 2021, Arxiv, DOI arXiv:2003.04390
[8]   Pareto Self-Supervised Training for Few-Shot Learning [J].
Chen, Zhengyu ;
Ge, Jixie ;
Zhan, Heshen ;
Huang, Siteng ;
Wang, Donglin .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :13658-13667
[9]   Frequency Guidance Matters in Few-Shot Learning [J].
Cheng, Hao ;
Yang, Siyuan ;
Zhou, Joey Tianyi ;
Guo, Lanqing ;
Wen, Bihan .
2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, :11780-11790
[10]   Imposing Semantic Consistency of Local Descriptors for Few-Shot Learning [J].
Cheng, Jun ;
Hao, Fusheng ;
Liu, Liu ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :1587-1600