Self-supervised deep contrastive and auto-regressive domain adaptation for time-series based on channel recalibration

被引:0
作者
Yang, Guangju [1 ,2 ]
Luo, Tian-jian [1 ,2 ,3 ]
Zhang, Xiaochen [1 ,2 ]
机构
[1] Fujian Normal Univ, Coll Comp & Cyber Secur, Fuzhou 350117, Peoples R China
[2] Fujian Normal Univ, Digital Fujian Internet of thing Lab Environm Moni, Fuzhou 350117, Peoples R China
[3] Fujian Normal Univ, Fujian Prov Key Lab Stat & Artificial Intelligence, Fuzhou 350117, Peoples R China
关键词
Time-series domain adaptation; Self-supervised learning; Contrastive learning; Auto-regressive discriminator; Channel recalibration;
D O I
10.1016/j.engappai.2025.110280
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Time-series based unsupervised domain adaptation (UDA) techniques have been widely adopted to the applications of intelligent systems, such as sleep staging, fault diagnosis, and human activity recognition. However, recently methods have overlooked the importance of temporal feature representations and the distribution discrepancies across domains, which deteriorated UDA performance. To address these challenges, we proposed a novel Self-supervised Deep Contrastive and Auto-regressive Domain Adaptation (SDCADA) model for crossdomain time-series classification. Specifically, the cross-domain mixup preprocessing strategy is applied to reduce sample-level distribution discrepancy, then we proposed to introduce the channel recalibration module for adaptively selecting discriminative representations. Afterwards, the auto-regressive discriminator and teacher model are proposed to reduce the distribution discrepancies of feature representations. Finally, a total of six losses, including contrastive and adversarial learning, are weighted and jointly optimized to train the SDCADA model. The proposed SDCADA model has been systematically experimented on four cross-domain time-series benchmarked datasets, and its classification performance surpasses several recently proposed state-of-the-art models. Moreover, it effectively captures discriminative and comprehensive cross-domain time-series feature representations with parameter insensitivity.
引用
收藏
页数:19
相关论文
共 67 条
[1]  
Anguita Davide, 2013, Esann, V3, P3, DOI DOI 10.1007/978-3-642-40728-4_54
[2]   Integrating structured biological data by Kernel Maximum Mean Discrepancy [J].
Borgwardt, Karsten M. ;
Gretton, Arthur ;
Rasch, Malte J. ;
Kriegel, Hans-Peter ;
Schoelkopf, Bernhard ;
Smola, Alex J. .
BIOINFORMATICS, 2006, 22 (14) :E49-E57
[3]  
Bousmalis K, 2016, ADV NEUR IN, V29
[4]   Multi-branch spatial-temporal-spectral convolutional neural networks for multi-task motor imagery EEG classification [J].
Cai, Zikun ;
Luo, Tian-jian ;
Cao, Xuan .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 93
[5]  
Chen C, 2020, AAAI CONF ARTIF INTE, V34, P3422
[6]   Dynamic contrastive learning guided by class confidence and confusion degree for medical image segmentation? [J].
Chen, Jingkun ;
Chen, Changrui ;
Huang, Wenjian ;
Zhang, Jianguo ;
Debattista, Kurt ;
Han, Jungong .
PATTERN RECOGNITION, 2024, 145
[7]  
Chen T, 2020, PR MACH LEARN RES, V119
[8]   Exploring Simple Siamese Representation Learning [J].
Chen, Xinlei ;
He, Kaiming .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :15745-15753
[9]   ROCKET: exceptionally fast and accurate time series classification using random convolutional kernels [J].
Dempster, Angus ;
Petitjean, Francois ;
Webb, Geoffrey, I .
DATA MINING AND KNOWLEDGE DISCOVERY, 2020, 34 (05) :1454-1495
[10]   ECGTransForm: Empowering adaptive ECG arrhythmia classification framework with bidirectional transformer [J].
El-Ghaish, Hany ;
Eldele, Emadeldeen .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 89