Self-supervised deep contrastive and auto-regressive domain adaptation for time-series based on channel recalibration

被引:0
作者
Yang, Guangju [1 ,2 ]
Luo, Tian-jian [1 ,2 ,3 ]
Zhang, Xiaochen [1 ,2 ]
机构
[1] Fujian Normal Univ, Coll Comp & Cyber Secur, Fuzhou 350117, Peoples R China
[2] Fujian Normal Univ, Digital Fujian Internet of thing Lab Environm Moni, Fuzhou 350117, Peoples R China
[3] Fujian Normal Univ, Fujian Prov Key Lab Stat & Artificial Intelligence, Fuzhou 350117, Peoples R China
关键词
Time-series domain adaptation; Self-supervised learning; Contrastive learning; Auto-regressive discriminator; Channel recalibration;
D O I
10.1016/j.engappai.2025.110280
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Time-series based unsupervised domain adaptation (UDA) techniques have been widely adopted to the applications of intelligent systems, such as sleep staging, fault diagnosis, and human activity recognition. However, recently methods have overlooked the importance of temporal feature representations and the distribution discrepancies across domains, which deteriorated UDA performance. To address these challenges, we proposed a novel Self-supervised Deep Contrastive and Auto-regressive Domain Adaptation (SDCADA) model for crossdomain time-series classification. Specifically, the cross-domain mixup preprocessing strategy is applied to reduce sample-level distribution discrepancy, then we proposed to introduce the channel recalibration module for adaptively selecting discriminative representations. Afterwards, the auto-regressive discriminator and teacher model are proposed to reduce the distribution discrepancies of feature representations. Finally, a total of six losses, including contrastive and adversarial learning, are weighted and jointly optimized to train the SDCADA model. The proposed SDCADA model has been systematically experimented on four cross-domain time-series benchmarked datasets, and its classification performance surpasses several recently proposed state-of-the-art models. Moreover, it effectively captures discriminative and comprehensive cross-domain time-series feature representations with parameter insensitivity.
引用
收藏
页数:19
相关论文
共 67 条
[61]  
Zhang LP, 2024, INT J NEURAL SYST, V34, DOI [10.1109/TNNLS.2022.3183326, 10.1142/S0129065724500230]
[62]   A cost-sensitive attention temporal convolutional network based on adaptive top-k differential evolution for imbalanced time-series classification [J].
Zhang, Xiaocai ;
Peng, Hui ;
Zhang, Jianjia ;
Wang, Yang .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 213
[63]   A novel performance degradation prognostics approach and its application on ball screw [J].
Zhang, Xiaochen ;
Luo, Tianjian ;
Han, Te ;
Gao, Hongli .
MEASUREMENT, 2022, 195
[64]   Pyramid Pixel Context Adaption Network for Medical Image Classification With Supervised Contrastive Learning [J].
Zhang, Xiaoqing ;
Xiao, Zunjie ;
Wu, Xiao ;
Chen, Yanlin ;
Zhao, Jilu ;
Hu, Yan ;
Liu, Jiang .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (04) :6802-6815
[65]   Regional context-based recalibration network for cataract recognition in AS-OCT [J].
Zhang, Xiaoqing ;
Xiao, Zunjie ;
Yang, Bing ;
Wu, Xiao ;
Higashita, Risa ;
Liu, Jiang .
PATTERN RECOGNITION, 2024, 147
[66]   Attention to region: Region-based integration-and-recalibration networks for nuclear cataract classification using AS-OCT images [J].
Zhang, Xiaoqing ;
Xiao, Zunjie ;
Fu, Huazhu ;
Hu, Yan ;
Yuan, Jin ;
Xu, Yanwu ;
Higashita, Risa ;
Liu, Jiang .
MEDICAL IMAGE ANALYSIS, 2022, 80
[67]  
Zhao SC, 2020, Arxiv, DOI arXiv:2002.12169