Zero-Shot Image Classification: Recent Status and Future Trends

被引:0
作者
Feng, Xiaodong [1 ]
Liu, Ying [1 ]
Chiew, Tuan Kiang [2 ]
机构
[1] Xian Univ Posts & Telecommun, Ctr Image & Informat Proc, Xian, Peoples R China
[2] Rekindle Pte Ltd, Singapore, Singapore
来源
2024 6TH INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING, ICNLP 2024 | 2024年
关键词
zero-shot learning; image classification; semantic embedding; generative model;
D O I
10.1109/ICNLP60986.2024.10692717
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning has achieved great success in image classification tasks. However, the majority of the methods can only recognize classes that have already appeared in the training set. In practical applications, it is also necessary to recognize classes that have not been appeared in the training set. Zero-shot learning can help to solve this problem. In zero-shot image classification, classes in the training set are entirely different from those used in the test set. This paper provides a systematic study on zero-shot image classification algorithms over the past few years. Firstly, we provide the research background of zero-shot image classification. Secondly, we introduce the basic concepts of various zero-shot image classification methods, including the semantic embedding and extraction of features. Thirdly, we categorize existing zero-shot image classification algorithms into three main groups - direct semantic prediction-based methods, space mapping-based methods, and generative model-based methods. We then analyze and compare their respective performance on three common datasets. Finally, we provide a summary of the technical challenges and future research directions of zero-shot image classification.
引用
收藏
页码:609 / 618
页数:10
相关论文
共 73 条
[1]  
Alamri F, 2021, Arxiv, DOI arXiv:2108.00045
[2]  
Chen S., 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence, P1
[3]  
Chen SM, 2022, AAAI CONF ARTIF INTE, P330
[4]   MSDN: Mutually Semantic Distillation Network for Zero-Shot Learning [J].
Chen, Shiming ;
Hong, Ziming ;
Xie, Guo-Sen ;
Yang, Wenhan ;
Peng, Qinmu ;
Wang, Kai ;
Zhao, Jian ;
You, Xinge .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, :7602-7611
[5]   FREE: Feature Refinement for Generalized Zero-Shot Learning [J].
Chen, Shiming ;
Wang, Wenjie ;
Xia, Beihao ;
Peng, Qinmu ;
You, Xinge ;
Zheng, Feng ;
Shao, Ling .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :122-131
[6]  
Chen Z, 2023, AAAI CONF ARTIF INTE, P405
[7]   Hybrid routing transformer for zero-shot learning [J].
Cheng, De ;
Wang, Gerong ;
Wang, Bo ;
Zhang, Qiang ;
Han, Jungong ;
Zhang, Dingwen .
PATTERN RECOGNITION, 2023, 137
[8]   A Continual Learning Survey: Defying Forgetting in Classification Tasks [J].
De Lange, Matthias ;
Aljundi, Rahaf ;
Masana, Marc ;
Parisot, Sarah ;
Jia, Xu ;
Leonardis, Ales ;
Slabaugh, Greg ;
Tuytelaars, Tinne .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (07) :3366-3385
[9]   Marginalized Latent Semantic Encoder for Zero-Shot Learning [J].
Ding, Zhengming ;
Liu, Hongfu .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :6184-6192
[10]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929