Domain Adaptive Few-Shot Open-Set Learning

被引:3
|
作者
Pal, Debabrata [1 ]
More, Deeptej [2 ]
Bhargav, Sai [1 ]
Tamboli, Dipesh [3 ]
Aggarwal, Vaneet [3 ]
Banerjee, Biplab [1 ]
机构
[1] Indian Inst Technol, Bombay, India
[2] Manipal Inst Technol, Manipal, India
[3] Purdue Univ, W Lafayette, IN USA
来源
2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023) | 2023年
关键词
D O I
10.1109/ICCV51070.2023.01726
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot learning has made impressive strides in addressing the crucial challenges of recognizing unknown samples from novel classes in target query sets and managing visual shifts between domains. However, existing techniques fall short when it comes to identifying target outliers under domain shifts by learning to reject pseudo-outliers from the source domain, resulting in an incomplete solution to both problems. To address these challenges comprehensively, we propose a novel approach called Domain Adaptive Few-Shot Open Set Recognition (DA-FSOS) and introduce a meta-learning-based architecture named DAFOSNET. During training, our model learns a shared and discriminative embedding space while creating a pseudo-open-space decision boundary, given a fully-supervised source domain and a label-disjoint few-shot target domain. To enhance data density, we use a pair of conditional adversarial networks with tunable noise variances to augment both domains' closed and pseudo-open spaces. Furthermore, we propose a domain-specific batch-normalized class prototypes alignment strategy to align both domains globally while ensuring class-discriminativeness through novel metric objectives. Our training approach ensures that DAFOS-NET can generalize well to new scenarios in the target domain. We present three benchmarks for DA-FSOS based on the Office-Home, mini-ImageNet/CUB, and DomainNet datasets and demonstrate the efficacy of DAFOSNet through extensive experimentation.
引用
收藏
页码:18785 / 18794
页数:10
相关论文
共 50 条
  • [1] Open-Set Likelihood Maximization for Few-Shot Learning
    Boudiaf, Malik
    Bennequin, Etienne
    Tami, Myriam
    Toubhans, Antoine
    Piantanida, Pablo
    Hudelot, Celine
    Ben Ayed, Ismail
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 24007 - 24016
  • [2] Learning Relative Feature Displacement for Few-Shot Open-Set Recognition
    Deng, Shule
    Yu, Jin-Gang
    Wu, Zihao
    Gao, Hongxia
    Li, Yansheng
    Yang, Yang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 5763 - 5774
  • [3] TASK-AGNOSTIC OPEN-SET PROTOTYPE FOR FEW-SHOT OPEN-SET RECOGNITION
    Kim, Byeonggeun
    Lee, Jun-Tae
    Shim, Kyuhong
    Chang, Simyung
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 31 - 35
  • [4] Few-shot Open-set Recognition by Transformation Consistency
    Jeong, Minki
    Choi, Seokeon
    Kim, Changick
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12561 - 12570
  • [5] Task-Adaptive Negative Envision for Few-Shot Open-Set Recognition
    Huang, Shiyuan
    Ma, Jiawei
    Han, Guangxing
    Chang, Shih-Fu
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 7161 - 7170
  • [6] Online Multiple Object Tracking Based on Open-Set Few-Shot Learning
    Kim, Han-Ul
    Koh, Yeong Jun
    Kim, Chang-Su
    IEEE ACCESS, 2020, 8 : 190312 - 190326
  • [7] Few-Shot Class-Incremental Learning from an Open-Set Perspective
    Peng, Can
    Zhao, Kun
    Wang, Tianren
    Li, Meng
    Lovell, Brian C.
    COMPUTER VISION, ECCV 2022, PT XXV, 2022, 13685 : 382 - 397
  • [8] A Multialignment Task-Adaptive Method for MFR Mode Recognition on Few-Shot Open-Set Learning
    Zhai, Qihang
    Liu, Jiabin
    Zhang, Zilin
    Li, Yan
    Wang, Shafei
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2024, 60 (06) : 7559 - 7574
  • [9] Glocal Energy-based Learning for Few-Shot Open-Set Recognition
    Wang, Haoyu
    Pang, Guansong
    Wang, Peng
    Zhang, Lei
    Wei, Wei
    Zhang, Yanning
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 7507 - 7516
  • [10] Toward Generalized Few-Shot Open-Set Object Detection
    Su, Binyi
    Zhang, Hua
    Li, Jingzhi
    Zhou, Zhong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 1389 - 1402