Source Hypothesis Transfer for Zero-Shot Domain Adaptation

被引:1
|
作者
Sakai, Tomoya [1 ]
机构
[1] NEC Corp Ltd, Tokyo, Japan
来源
MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES | 2021年 / 12975卷
关键词
Hypothesis transfer learning; Zero-shot domain adaptation; Unseen domains; Domain adaptation;
D O I
10.1007/978-3-030-86486-6_35
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Making predictions in target unseen domains without training samples is frequent in real-world applications, such as new products' sales predictions. Zero-shot domain adaptation (ZSDA) has been studied to achieve this important but difficult task. An approach to ZSDA is to use multiple source domain data and domain attributes. Several recent domain adaptation studies have mentioned that source domain data are not often available due to privacy, technical, and contractual issues in practice. To address these issues, hypothesis transfer learning (HTL) has been gaining attention since it does not require access to source domain data. It has shown its effectiveness in supervised/unsupervised domain adaptation; however current HTL methods cannot be readily applied to ZSDA because we have no training data (even unlabeled data) for target domains. To solve this problem, we propose an HTL-based ZSDA method that connects multiple source hypotheses by domain attributes. Through theoretical analysis, we derive the convergence rate of the estimation error of our proposed method. Finally, we numerically demonstrate the effectiveness of our proposed HTL-based ZSDA method.
引用
收藏
页码:570 / 586
页数:17
相关论文
共 50 条
  • [21] Source-free domain adaptation with unrestricted source hypothesis
    He, Jiujun
    Wu, Liang
    Tao, Chaofan
    Lv, Fengmao
    PATTERN RECOGNITION, 2024, 149
  • [22] Adversarial Distillation Adaptation Model with Sentiment Contrastive Learning for Zero-Shot Stance Detection
    Zhang, Yu
    Wang, Chunling
    Wang, Jia
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2023, 16 (01)
  • [23] Zero-shot knowledge transfer for seismic damage diagnosis through multi-channel 1D CNN integrated with autoencoder-based domain adaptation
    Xiong, Qingsong
    Kong, Qingzhao
    Xiong, Haibei
    Chen, Jiawei
    Yuan, Cheng
    Wang, Xiaoyou
    Xia, Yong
    MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2024, 217
  • [24] Adversarial Distillation Adaptation Model with Sentiment Contrastive Learning for Zero-Shot Stance Detection
    Yu Zhang
    Chunling Wang
    Jia Wang
    International Journal of Computational Intelligence Systems, 16
  • [25] Zero-shot stance detection: Paradigms and challenges
    Allaway, Emily
    McKeown, Kathleen
    FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2023, 5
  • [26] Zero-shot test time adaptation via knowledge distillation for personalized speech denoising and dereverberation
    Kim, Sunwoo
    Athi, Mrudula
    Shi, Guangji
    Kim, Minje
    Kristjansson, Trausti
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2024, 155 (02) : 1353 - 1367
  • [27] Unleashing Knowledge Potential of Source Hypothesis for Source-Free Domain Adaptation
    Hu, Bingyu
    Liu, Jiawei
    Zheng, Kecheng
    Zha, Zheng-Jun
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 5422 - 5434
  • [28] Learning cross-domain semantic-visual relationships for transductive zero-shot learning
    Lv, Fengmao
    Zhang, Jianyang
    Yang, Guowu
    Feng, Lei
    Yu, Yufeng
    Duan, Lixin
    PATTERN RECOGNITION, 2023, 141
  • [29] On the Importance of Attention and Augmentations for Hypothesis Transfer in Domain Adaptation and Generalization
    Thomas, Georgi
    Sahay, Rajat
    Jahan, Chowdhury Sadman
    Manjrekar, Mihir
    Popp, Dan
    Savakis, Andreas
    SENSORS, 2023, 23 (20)
  • [30] TEST-TIME ADAPTATION TOWARD PERSONALIZED SPEECH ENHANCEMENT: ZERO-SHOT LEARNING WITH KNOWLEDGE DISTILLATION
    Kim, Sunwoo
    Kim, Minje
    2021 IEEE WORKSHOP ON APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS (WASPAA), 2021, : 176 - 180