Beyond Normal Distribution: More Factual Feature Generation Network for Generalized Zero-Shot Learning

被引:3
作者
Liu, Jingren [1 ]
Bai, Haoyue [1 ]
Zhang, Haofeng [1 ]
Liu, Li [2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Incept Inst Artificial Intelligence, Comp Vis, Abu Dhabi, U Arab Emirates
基金
中国国家自然科学基金;
关键词
Visualization; Task analysis; Training; Semantics; Prototypes; Generators; Standards; Generalized ZSL; Generative Models; Data-driven Noise; Factual Features Generation;
D O I
10.1109/MMUL.2022.3155541
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Due to the prosperous development of generative models, research works have achieved great success on the generalized zero-shot learning (GZSL) task. In most generative methods of GZSL, researchers try to utilize attributes and normally distributed noise to generate visual features, which ignores whether the normal distribution can perfectly represent all categories. Therefore, in this article, we exploit variational auto-encoders (VAE) and visual features to generate image-level noise that can preserve class-level characteristics in more detail and propose a mechanism called more factual generative network (MFGN) to achieve more authentic generative process. In other words, it is to transfer the seen feature distribution to the unseen domains and regulate the knowledge to correct the generation of unseen samples. Extensive experiments are conducted on four popular datasets and the results demonstrate the effectiveness of the proposed work.
引用
收藏
页码:69 / 79
页数:11
相关论文
共 20 条
[1]   An Empirical Study and Analysis of Generalized Zero-Shot Learning for Object Recognition in the Wild [J].
Chao, Wei-Lun ;
Changpinyo, Soravit ;
Gong, Boqing ;
Sha, Fei .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :52-68
[2]   Marginalized Latent Semantic Encoder for Zero-Shot Learning [J].
Ding, Zhengming ;
Liu, Hongfu .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :6184-6192
[3]  
Farhadi A, 2009, PROC CVPR IEEE, P1778, DOI 10.1109/CVPRW.2009.5206772
[4]  
Felix R., 2019, arXiv
[5]   Learning the Redundancy-free Features for Generalized Zero-Shot Object Recognition [J].
Han, Zongyan ;
Fu, Zhenyong ;
Yang, Jian .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :12862-12871
[6]   Generative Dual Adversarial Network for Generalized Zero-shot Learning [J].
Huang, He ;
Wang, Changhu ;
Yu, Philip S. ;
Wang, Chang-Dong .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :801-810
[7]   Transferable Contrastive Network for Generalized Zero-Shot Learning [J].
Jiang, Huajie ;
Wang, Ruiping ;
Shan, Shiguang ;
Chen, Xilin .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :9764-9773
[8]   Generalized Zero-Shot Learning Via Over-Complete Distribution [J].
Keshari, Rohit ;
Singh, Richa ;
Vatsa, Mayank .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :13297-13305
[9]  
Lampert CH, 2009, PROC CVPR IEEE, P951, DOI 10.1109/CVPRW.2009.5206594
[10]   Leveraging the Invariant Side of Generative Zero-Shot Learning [J].
Li, Jingjing ;
Jing, Mengmeng ;
Lu, Ke ;
Ding, Zhengming ;
Zhu, Lei ;
Huang, Zi .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :7394-7403