Attribute-Induced Bias Eliminating for Transductive Zero-Shot Learning

被引:5
作者
Yao, Hantao [1 ]
Min, Shaobo [2 ]
Zhang, Yongdong [2 ]
Xu, Changsheng [1 ,3 ]
机构
[1] Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
[2] Univ Sci & Technol China, Natl Engn Lab Brain Inspired Intelligence Technol, Hefei 230026, Peoples R China
[3] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Semantics; Visualization; Bridges; Training; Knowledge transfer; Image recognition; Topology; Transductive Zero-Shot Learning; Graph Attribute Embedding; Attribute-Induced Bias Eliminating; Semantic-Visual Alignment;
D O I
10.1109/TMM.2021.3074252
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Transductive zero-shot learning is designed to recognize unseen categories by aligning both visual and semantic information in a joint embedding space. Four types of domain biases exist in Transductive ZSL, i.e., visual bias and semantic bias in two domains, and two visual-semantic biases exist in the seen and unseen domains. However, the existing work has only focused on specific components of these topics, leading to severe semantic ambiguity during knowledge transfer. To solve this problem, we propose a novel attribute-induced bias eliminating (AIBE) module for Transductive ZSL. Specifically, for the visual bias between the two domains, the mean-teacher module is first used to bridge the visual representation discrepancy between the two domains using unsupervised learning and unlabeled images. Then, an attentional graph attribute embedding process is proposed to reduce the semantic bias between seen and unseen categories using a graph operation to describe the semantic relationship between categories. To reduce semantic-visual bias in the seen domain, we align the visual center of each category with the corresponding semantic attributes instead of with the individual visual data point, which preserves the semantic relationship in the embedding space. Finally, for the semantic-visual bias in the unseen domain, an unseen semantic alignment constraint is designed to align visual and semantic space using an unsupervised process. The evaluations on several benchmarks demonstrate the effectiveness of the proposed method, e.g., 82.8%/75.5%, 97.1%/82.5%, and 73.2%/52.1% for Conventional/Generalized ZSL settings for CUB, AwA2, and SUN datasets, respectively.
引用
收藏
页码:1933 / 1942
页数:10
相关论文
共 50 条
  • [21] Zero-Shot Defect Detection With Anomaly Attribute Awareness via Textual Domain Bridge
    Zhang, Zhe
    Chen, Shu
    Huang, Jian
    Ma, Jie
    IEEE SENSORS JOURNAL, 2025, 25 (07) : 11759 - 11771
  • [22] Transfer Increment for Generalized Zero-Shot Learning
    Feng, Liangjun
    Zhao, Chunhui
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (06) : 2506 - 2520
  • [23] Domain-Oriented Semantic Embedding for Zero-Shot Learning
    Min, Shaobo
    Yao, Hantao
    Xie, Hongtao
    Zha, Zheng-Jun
    Zhang, Yongdong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 3919 - 3930
  • [24] Learning Multipart Attention Neural Network for Zero-Shot Classification
    Meng, Min
    Wei, Jie
    Wu, Jigang
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2022, 14 (02) : 414 - 423
  • [25] GT-GAN: A General Transductive Zero-Shot Learning Method Based on GAN
    Dong, Junhao
    Xiao, Bo
    Ding, Bo
    Wang, Haoyu
    IEEE ACCESS, 2020, 8 : 147173 - 147184
  • [26] Anchor-based discriminative dual distribution calibration for transductive zero-shot learning
    Zhang, Yi
    Huang, Sheng
    Yang, Wanli
    Tang, Wenhao
    Zhang, Xiaohong
    Yang, Dan
    IMAGE AND VISION COMPUTING, 2023, 137
  • [27] Language-Augmented Pixel Embedding for Generalized Zero-Shot Learning
    Wang, Ziyang
    Gou, Yunhao
    Li, Jingjing
    Zhu, Lei
    Shen, Heng Tao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (03) : 1019 - 1030
  • [28] Investigating the Bilateral Connections in Generative Zero-Shot Learning
    Li, Jingjing
    Jing, Mengmeng
    Lu, Ke
    Zhu, Lei
    Shen, Heng Tao
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (08) : 8167 - 8178
  • [29] An Iterative Co-Training Transductive Framework for Zero Shot Learning
    Liu, Bo
    Hu, Lihua
    Dong, Qiulei
    Hu, Zhanyi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 6943 - 6956
  • [30] Deep Unbiased Embedding Transfer for Zero-Shot Learning
    Jia, Zhen
    Zhang, Zhang
    Wang, Liang
    Shan, Caifeng
    Tan, Tieniu
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 1958 - 1971