A Decomposable Causal View of Compositional Zero-Shot Learning

被引:7
|
作者
Yang, Muli [1 ]
Xu, Chenghao [1 ]
Wu, Aming [1 ]
Deng, Cheng [1 ]
机构
[1] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Compositional zero-shot learning; vision and language; image recognition; causality;
D O I
10.1109/TMM.2022.3200578
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Composing and recognizing novel concepts that are combinations of known concepts, i.e., compositional generalization, is one of the greatest power of human intelligence. With the development of artificial intelligence, it becomes increasingly appealing to build a vision system that can generalize to unknown compositions based on restricted known knowledge, which has so far remained a great challenge to our community. In fact, machines can be easily misled by superficial correlations in the data, disregarding the causal patterns that are crucial to generalization. In this paper, we rethink compositional generalization with a causal perspective, upon the context of Compositional Zero-Shot Learning (CZSL). We develop a simple yet strong approach based on our novel Decomposable Causal view (dubbed "DECA"), by approximating the causal effect with the combination of three easy-to-learn components. Our proposed DECA(1) is evaluated on two challenging CZSL benchmarks by recognizing unknown compositions of known concepts. Despite being simple in the design, our approach achieves consistent improvements over state-of-the-art baselines, demonstrating its superiority towards the goal of compositional generalization.
引用
收藏
页码:5892 / 5902
页数:11
相关论文
共 50 条
  • [31] Attribute-Induced Bias Eliminating for Transductive Zero-Shot Learning
    Yao, Hantao
    Min, Shaobo
    Zhang, Yongdong
    Xu, Changsheng
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 1933 - 1942
  • [32] Domain-Aware Prototype Network for Generalized Zero-Shot Learning
    Hu, Yongli
    Feng, Lincong
    Jiang, Huajie
    Liu, Mengting
    Yin, Baocai
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (05) : 3180 - 3191
  • [33] Class-specific synthesized dictionary model for Zero-Shot Learning
    Ji, Zhong
    Wang, Junyue
    Yu, Yunlong
    Pang, Yanwei
    Han, Jungong
    NEUROCOMPUTING, 2019, 329 : 339 - 347
  • [34] Vocabulary-Informed Zero-Shot and Open-Set Learning
    Fu, Yanwei
    Wang, Xiaomei
    Dong, Hanze
    Jiang, Yu-Gang
    Wang, Meng
    Xue, Xiangyang
    Sigal, Leonid
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (12) : 3136 - 3152
  • [35] Wheel Hub Defects Image Recognition Base on Zero-Shot Learning
    Sun, Xiaohong
    Gu, Jinan
    Wang, Meimei
    Meng, Yanhua
    Shi, Huichao
    APPLIED SCIENCES-BASEL, 2021, 11 (04): : 1 - 16
  • [36] Manifold embedding for zero-shot recognition
    Ji, Zhong
    Yu, Xuejie
    Yu, Yunlong
    He, Yuqing
    COGNITIVE SYSTEMS RESEARCH, 2019, 55 : 34 - 43
  • [37] SimpleZSL: Extremely Simple and Fast Zero-Shot Learning with Nearest Neighbor Classifiers
    Hiromoto, Masayuki
    Akima, Hisanao
    Ishihara, Teruo
    Yamamoto, Takuji
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2022, E105D (02) : 396 - 405
  • [38] Multi-Modality Adversarial Auto-Encoder for Zero-Shot Learning
    Ji, Zhong
    Dai, Guangwen
    Yu, Yunlong
    IEEE ACCESS, 2020, 8 (08): : 9287 - 9295
  • [39] Zero-Shot Image Retrieval with Human Feedback
    Agnolucci, Lorenzo
    Baldrati, Alberto
    Bertini, Marco
    Del Bimbo, Alberto
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 9417 - 9419
  • [40] Zero-shot learning via visual feature enhancement and dual classifier learning for image recognition
    Zhao, Peng
    Xue, Huihui
    Ji, Xia
    Liu, Huiting
    Han, Li
    INFORMATION SCIENCES, 2023, 642