Attribute-Induced Bias Eliminating for Transductive Zero-Shot Learning

被引:5
作者
Yao, Hantao [1 ]
Min, Shaobo [2 ]
Zhang, Yongdong [2 ]
Xu, Changsheng [1 ,3 ]
机构
[1] Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
[2] Univ Sci & Technol China, Natl Engn Lab Brain Inspired Intelligence Technol, Hefei 230026, Peoples R China
[3] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Semantics; Visualization; Bridges; Training; Knowledge transfer; Image recognition; Topology; Transductive Zero-Shot Learning; Graph Attribute Embedding; Attribute-Induced Bias Eliminating; Semantic-Visual Alignment;
D O I
10.1109/TMM.2021.3074252
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Transductive zero-shot learning is designed to recognize unseen categories by aligning both visual and semantic information in a joint embedding space. Four types of domain biases exist in Transductive ZSL, i.e., visual bias and semantic bias in two domains, and two visual-semantic biases exist in the seen and unseen domains. However, the existing work has only focused on specific components of these topics, leading to severe semantic ambiguity during knowledge transfer. To solve this problem, we propose a novel attribute-induced bias eliminating (AIBE) module for Transductive ZSL. Specifically, for the visual bias between the two domains, the mean-teacher module is first used to bridge the visual representation discrepancy between the two domains using unsupervised learning and unlabeled images. Then, an attentional graph attribute embedding process is proposed to reduce the semantic bias between seen and unseen categories using a graph operation to describe the semantic relationship between categories. To reduce semantic-visual bias in the seen domain, we align the visual center of each category with the corresponding semantic attributes instead of with the individual visual data point, which preserves the semantic relationship in the embedding space. Finally, for the semantic-visual bias in the unseen domain, an unseen semantic alignment constraint is designed to align visual and semantic space using an unsupervised process. The evaluations on several benchmarks demonstrate the effectiveness of the proposed method, e.g., 82.8%/75.5%, 97.1%/82.5%, and 73.2%/52.1% for Conventional/Generalized ZSL settings for CUB, AwA2, and SUN datasets, respectively.
引用
收藏
页码:1933 / 1942
页数:10
相关论文
共 50 条
  • [1] Holistically Associated Transductive Zero-Shot Learning
    Xu, Yangyang
    Xu, Xuemiao
    Han, Guoqiang
    He, Shengfeng
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2022, 14 (02) : 437 - 447
  • [2] On Implicit Attribute Localization for Generalized Zero-Shot Learning
    Yang, Shiqi
    Wang, Kai
    Herranz, Luis
    van de Weijer, Joost
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 872 - 876
  • [3] Learning Unbiased Zero-Shot Semantic Segmentation Networks Via Transductive Transfer
    Lv, Fengmao
    Liu, Haiyang
    Wang, Yichen
    Zhao, Jiayi
    Yang, Guowu
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 1640 - 1644
  • [4] Content-Attribute Disentanglement for Generalized Zero-Shot Learning
    An, Yoojin
    Kim, Sangyeon
    Liang, Yuxuan
    Zimmermann, Roger
    Kim, Dongho
    Kim, Jihie
    IEEE ACCESS, 2022, 10 : 58320 - 58331
  • [5] Transductive Zero-Shot Hashing for Multilabel Image Retrieval
    Zou, Qin
    Cao, Ling
    Zhang, Zheng
    Chen, Long
    Wang, Song
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (04) : 1673 - 1687
  • [6] VMAN: A Virtual Mainstay Alignment Network for Transductive Zero-Shot Learning
    Xie, Guo-Sen
    Zhang, Xu-Yao
    Yao, Yazhou
    Zhang, Zheng
    Zhao, Fang
    Shao, Ling
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 4316 - 4329
  • [7] Boosting Zero-Shot Learning via Contrastive Optimization of Attribute Representations
    Du, Yu
    Shi, Miaojing
    Wei, Fangyun
    Li, Guoqi
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (11) : 16706 - 16719
  • [8] Iterative Class Prototype Calibration for Transductive Zero-Shot Learning
    Yang, Hairui
    Sun, Baoli
    Li, Baopu
    Yang, Caifei
    Wang, Zhihui
    Chen, Jenhui
    Wang, Lei
    Li, Haojie
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (03) : 1236 - 1246
  • [9] Zero-Shot Learning Based on Deep Weighted Attribute Prediction
    Wang, Xuesong
    Chen, Chen
    Cheng, Yuhu
    Chen, Xun
    Liu, Yu
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2020, 50 (08): : 2948 - 2957
  • [10] Incremental Zero-Shot Learning
    Wei, Kun
    Deng, Cheng
    Yang, Xu
    Tao, Dacheng
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (12) : 13788 - 13799