Rethinking attribute localization for zero-shot learning

被引:4
作者
Chen, Shuhuang [1 ]
Chen, Shiming [1 ]
Xie, Guo-Sen [2 ]
Shu, Xiangbo [2 ]
You, Xinge [1 ]
Li, Xuelong [3 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Elect Informat & Commun, Wuhan 430074, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[3] Northwestern Polytech Univ, Sch Artificial Intelligence Opt & Elect, Xian 710072, Peoples R China
基金
国家重点研发计划;
关键词
zero-shot learning; attention mechanism; attribute localization; image classification; CLASSIFICATION;
D O I
10.1007/s11432-023-4051-9
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent advancements in attribute localization have showcased its potential in discovering the intrinsic semantic knowledge for visual feature representations, thereby facilitating significant visual-semantic interactions essential for zero-shot learning (ZSL). However, the majority of existing attribute localization methods heavily rely on classification constraints, resulting in accurate localization of only a few attributes while neglecting the rest important attributes associated with other classes. This limitation hinders the discovery of the intrinsic semantic relationships between attributes and visual features across all classes. To address this problem, we propose a novel attribute localization refinement (ALR) module designed to enhance the model's ability to accurately localize all attributes. Essentially, we enhance weak discriminant attributes by grouping them and introduce weighted attribute regression to standardize the mapping values of semantic attributes. This module can be flexibly combined with existing attribute localization methods. Our experiments show that when combined with the ALR module, the localization errors in existing methods are corrected, and state-of-the-art classification performance is achieved.
引用
收藏
页数:13
相关论文
共 55 条
[1]  
[Anonymous], 2018, Advances in Neural Information Processing Systems
[2]   An Empirical Study and Analysis of Generalized Zero-Shot Learning for Object Recognition in the Wild [J].
Chao, Wei-Lun ;
Changpinyo, Soravit ;
Gong, Boqing ;
Sha, Fei .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :52-68
[3]   Zero-Shot Visual Recognition using Semantics-Preserving Adversarial Embedding Networks [J].
Chen, Long ;
Zhang, Hanwang ;
Xiao, Jun ;
Liu, Wei ;
Chang, Shih-Fu .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1043-1052
[4]   EGANS: Evolutionary Generative Adversarial Network Search for Zero-Shot Learning [J].
Chen, Shiming ;
Chen, Shuhuang ;
Hou, Wenjin ;
Ding, Weiping ;
You, Xinge .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2024, 28 (03) :582-596
[5]   TransZero plus plus : Cross Attribute-Guided Transformer for Zero-Shot Learning [J].
Chen, Shiming ;
Hong, Ziming ;
Hou, Wenjin ;
Xie, Guo-Sen ;
Song, Yibing ;
Zhao, Jian ;
You, Xinge ;
Yan, Shuicheng ;
Shao, Ling .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (11) :12844-12861
[6]  
Chen SM, 2022, AAAI CONF ARTIF INTE, P330
[7]   MSDN: Mutually Semantic Distillation Network for Zero-Shot Learning [J].
Chen, Shiming ;
Hong, Ziming ;
Xie, Guo-Sen ;
Yang, Wenhan ;
Peng, Qinmu ;
Wang, Kai ;
Zhao, Jian ;
You, Xinge .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, :7602-7611
[8]   FREE: Feature Refinement for Generalized Zero-Shot Learning [J].
Chen, Shiming ;
Wang, Wenjie ;
Xia, Beihao ;
Peng, Qinmu ;
You, Xinge ;
Zheng, Feng ;
Shao, Ling .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :122-131
[9]   GNDAN: Graph Navigated Dual Attention Network for Zero-Shot Learning [J].
Chen, Shiming ;
Hong, Ziming ;
Xie, Guosen ;
Peng, Qinmu ;
You, Xinge ;
Ding, Weiping ;
Shao, Ling .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (04) :4516-4529
[10]  
Chen SZ, 2021, ADV NEUR IN, V34