Domain adaptation of time series via contrastive learning with task-specific consistency

被引:0
|
作者
Wu, Tao [1 ]
Chen, Qiushu [2 ]
Zhao, Dongfang [3 ]
Wang, Jinhua [4 ]
Jiang, Linhua [1 ,5 ]
机构
[1] Fudan Univ, Acad Engn & Technol, Shanghai 200433, Peoples R China
[2] Fudan Univ, Dept Opt Sci & Engn, Shanghai 200433, Peoples R China
[3] Univ Washington, Tacoma Sch Engn & Technol, Seattle, WA 98195 USA
[4] Nuo Beta Pharmaceut Technol Shanghai Co Ltd, Shanghai 201210, Peoples R China
[5] French Inst Business Management & Technol, ISEP Sorbonne Joint Res Lab, F-92130 Paris, France
基金
中国国家自然科学基金;
关键词
Domain adaptation; Time series; Contrastive learning; Domain shift; Transfer learning;
D O I
10.1007/s10489-024-05799-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised domain adaptation (UDA) for time series analysis remains challenging due to the lack of labeled data in target domains. Existing methods rely heavily on auxiliary data yet often fail to fully exploit the intrinsic task consistency between different domains. To address this limitation, we propose a novel time series UDA framework called CLTC that enhances feature transferability by capturing semantic context and reconstructing class-wise representations. Specifically, contrastive learning is first utilized to capture contextual representations that enable label transfer across domains. Dual reconstruction on samples from the same class then refines the task-specific features to improve consistency. To align the cross-domain distributions without target labels, we leverage Sinkhorn divergence which can handle non-overlapping supports. Consequently, our CLTC reduces the domain gap while retaining task-specific consistency for effective knowledge transfer. Extensive experiments on four time series benchmarks demonstrate state-of-the-art performance improvements of 0.7-3.6% over existing methods, and ablation study validates the efficacy of each component.
引用
收藏
页码:12576 / 12588
页数:13
相关论文
共 50 条
  • [1] TSP: Learning Task-Specific Pivots for Unsupervised Domain Adaptation
    Cui, Xia
    Coenen, Frans
    Bollegala, Danushka
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2017, PT II, 2017, 10535 : 754 - 771
  • [2] Contrastive Domain Adaptation for Time-Series Via Temporal Mixup
    Eldele E.
    Ragab M.
    Chen Z.
    Wu M.
    Kwoh C.-K.
    Li X.
    IEEE Transactions on Artificial Intelligence, 2024, 5 (03): : 1185 - 1194
  • [3] Unifying TopDown Views by Task-Specific Domain Adaptation
    Lin, Jianzhe
    Yu, Tianze
    Mou, Lichao
    Zhu, Xiaoxiang
    Ward, Rabab Kreidieh
    Wang, Z. Jane
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (06): : 4689 - 4702
  • [4] Contrastive representation learning for time series via compound consistency and hierarchical contrasting
    Zheng, Teng
    Cao, Guanghao
    Chen, Lei
    Hao, Kuangrong
    2023 IEEE 12TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE, DDCLS, 2023, : 1623 - 1628
  • [5] Latent space decomposition into task-specific and domain-specific subspaces for domain adaptation
    Ueda, Takaya
    Nishikawa, Ikuko
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [6] Integrating multimodal contrastive learning with prototypical domain alignment for unsupervised domain adaptation of time series
    Park, Seo-Hyeong
    Syazwany, Nur Suriza
    Nam, Ju-Hyeon
    Lee, Sang-Chul
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 137
  • [7] Task-oriented contrastive learning for unsupervised domain adaptation
    Wei, Xing
    Wen, Bin
    Yang, Fan
    Liu, Yujie
    Zhao, Chong
    Hu, Di
    Luo, Hui
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 229
  • [8] Learning Task-Specific Embeddings for Few-Shot Classification via Local Weight Adaptation
    Gong, Nianru
    Duan, Pengfei
    Rong, Yi
    2024 16TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND COMPUTING, ICMLC 2024, 2024, : 485 - 491
  • [9] Domain Adaptation via a Task-Specific Classifier Framework for Remote Sensing Cross-Scene Classification
    Zheng, Zhendong
    Zhong, Yanfei
    Su, Yu
    Ma, Ailong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [10] TMDA: Task-Specific Multi-Source Domain Adaptation via Clustering Embedded Adversarial Training
    Wang, Haotian
    Yang, Wenjing
    Lin, Zhipeng
    Yu, Yue
    2019 19TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2019), 2019, : 1372 - 1377