Dual-level contrastive learning network for generalized zero-shot learning

被引:6
作者
Guan, Jiaqi [1 ]
Meng, Min [1 ]
Liang, Tianyou [1 ]
Liu, Jigang [2 ]
Wu, Jigang [1 ]
机构
[1] Guangdong Univ Technol, Sch Comp Sci & Technol, Guangzhou, Peoples R China
[2] Ping An Life Insurance China, Shenzhen, Peoples R China
基金
中国国家自然科学基金;
关键词
Generalized zero-shot learning; Contrastive learning; Generative adversarial networks;
D O I
10.1007/s00371-022-02539-6
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Generalized zero-shot learning (GZSL) aims to utilize semantic information to recognize the seen and unseen samples, where unseen classes are unavailable during training. Though recent advances have been made by incorporating contrastive learning into GZSL, existing approaches still suffer from two limitations: (1) without considering fine-grained cluster structures, these models cannot guarantee the discriminability and semantic awareness of synthetic features; (2) classifiers tend to overfit the seen classes, as they only concentrate on the seen domain. To address these challenges, we propose a Dual-level Contrastive Learning Network (DCLN), in which intra-domain and cross-domain contrastive learning are seamlessly integrated into a unified learning model. Specifically, the former performs center-prototype contrasting to fully explore the discriminative structure knowledge, while the latter is proposed to effectively alleviate the overfitting problem by utilizing the semantic relationships between the seen and unseen domain. Finally, the experimental results on four benchmark datasets demonstrate the superiority of our DCLN over the state-of-the-art methods.
引用
收藏
页码:3087 / 3095
页数:9
相关论文
共 35 条
[1]   FREE: Feature Refinement for Generalized Zero-Shot Learning [J].
Chen, Shiming ;
Wang, Wenjie ;
Xia, Beihao ;
Peng, Qinmu ;
You, Xinge ;
Zheng, Feng ;
Shao, Ling .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :122-131
[2]  
Chen T., 2020, ICML
[3]   A Boundary Based Out-of-Distribution Classifier for Generalized Zero-Shot Learning [J].
Chen, Xingyu ;
Lan, Xuguang ;
Sun, Fuchun ;
Zheng, Nanning .
COMPUTER VISION - ECCV 2020, PT XXIV, 2020, 12369 :572-588
[4]   Fine-Grained Generalized Zero-Shot Learning via Dense Attribute-Based Attention [J].
Dat Huynh ;
Elhamifar, Ehsan .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :4482-4492
[5]  
Frome A., 2013, Advances in neural information processing systems
[6]   Zero-Shot Learning on Semantic Class Prototype Graph [J].
Fu, Zhenyong ;
Xiang, Tao ;
Kodirov, Elyor ;
Gong, Shaogang .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (08) :2009-2022
[7]  
Goodfellow I. J., 2014, P ANN C NEUR INF PRO
[8]   Contrastive Embedding for Generalized Zero-Shot Learning [J].
Han, Zongyan ;
Fu, Zhenyong ;
Chen, Shuo ;
Yang, Jian .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :2371-2381
[9]   Learning the Redundancy-free Features for Generalized Zero-Shot Object Recognition [J].
Han, Zongyan ;
Fu, Zhenyong ;
Yang, Jian .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :12862-12871
[10]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778