CALDA: Improving Multi-Source Time Series Domain Adaptation With Contrastive Adversarial Learning

被引:22
作者
Wilson, Garrett [1 ]
Doppa, Janardhan Rao [1 ]
Cook, Diane J. [1 ]
机构
[1] Washington State Univ, Sch Elect Engn & Comp Sci, Pullman, WA 99164 USA
基金
美国国家科学基金会; 美国国家卫生研究院;
关键词
Feature extraction; Training; Time series analysis; Task analysis; Mathematical models; Data augmentation; Adaptation models; Adversarial training; contrastive learning; domain adaptation; time series; transfer learning; weak supervision;
D O I
10.1109/TPAMI.2023.3298346
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised domain adaptation (UDA) provides a strategy for improving machine learning performance in data-rich (target) domains where ground truth labels are inaccessible but can be found in related (source) domains. In cases where meta-domain information such as label distributions is available, weak supervision can further boost performance. We propose a novel framework, CALDA, to tackle these two problems. CALDA synergistically combines the principles of contrastive learning and adversarial learning to robustly support multi-source UDA (MS-UDA) for time series data. Similar to prior methods, CALDA utilizes adversarial learning to align source and target feature representations. Unlike prior approaches, CALDA additionally leverages cross-source label information across domains. CALDA pulls examples with the same label close to each other, while pushing apart examples with different labels, reshaping the space through contrastive learning. Unlike prior contrastive adaptation methods, CALDA requires neither data augmentation nor pseudo labeling, which may be more challenging for time series. We empirically validate our proposed approach. Based on results from human activity recognition, electromyography, and synthetic datasets, we find utilizing cross-source information improves performance over prior time series and contrastive methods. Weak supervision further improves performance, even in the presence of noise, allowing CALDA to offer generalizable strategies for MS-UDA.
引用
收藏
页码:14208 / 14221
页数:14
相关论文
共 56 条
[1]  
Akuzawa K., 2019, arXiv
[2]   A Deep Transfer Learning Approach to Reducing the Effect of Electrode Shift in EMG Pattern Recognition-Based Control [J].
Ameri, Ali ;
Akhaee, Mohammad Ali ;
Scheme, Erik ;
Englehart, Kevin .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (02) :370-379
[3]  
Anguita D., 2013, 21 EUROPEAN S ARTIFI, V3, P437
[4]  
Bharambe A., 2021, Mobile Comput. Sustain. Inform., V534, P239
[5]  
Blanchard G., 2011, Advances in neural information processing systems, P2178
[6]   Sampling rate-corrected analysis of irregularly sampled time series [J].
Braun, Tobias ;
Fernandez, Cinthya N. ;
Eroglu, Deniz ;
Hartland, Adam ;
Breitenbach, Sebastian F. M. ;
Marwan, Norbert .
PHYSICAL REVIEW E, 2022, 105 (02)
[7]  
Cai RC, 2021, AAAI CONF ARTIF INTE, V35, P6859
[8]  
Chen Ting, 2019, PMLR
[9]  
Choi J, 2019, Arxiv, DOI arXiv:1908.00262
[10]   Deep Learning for Electromyographic Hand Gesture Signal Classification Using Transfer Learning [J].
Cote-Allard, Ulysse ;
Fall, Cheikh Latyr ;
Drouin, Alexandre ;
Campeau-Lecours, Alexandre ;
Gosselin, Clement ;
Glette, Kyrre ;
Laviolette, Francois ;
Gosselin, Benoit .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2019, 27 (04) :760-771