Diffusion-Model-Based Contrastive Learning for Human Activity Recognition

被引:7
作者
Xiao, Chunjing [1 ,2 ]
Han, Yanhui [3 ,4 ]
Yang, Wei [3 ,4 ]
Hou, Yane [3 ,4 ]
Shi, Fangzhan [5 ]
Chetty, Kevin [5 ]
机构
[1] Henan Univ, Sch Comp & Informat Engn, Kaifeng 475004, Peoples R China
[2] UCL, London WC1E 6BT, England
[3] Henan Univ, Sch Comp & Informat Engn, Kaifeng 475004, Peoples R China
[4] Henan Univ, Henan Key Lab Big Data Anal & Proc, Kaifeng 475004, Peoples R China
[5] UCL, Dept Secur & Crime Sci, London WC1E 6BT, England
基金
中国国家自然科学基金;
关键词
Contrastive learning; Data models; Adaptation models; Training; Computational modeling; Training data; Fluctuations; Activity recognition; contrastive learning; diffusion probabilistic models; self-supervised learning; WiFi channel state information (CSI); CSI;
D O I
10.1109/JIOT.2024.3429245
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
WiFi channel state information (CSI)-based activity recognition has sparked numerous studies due to its widespread availability and privacy protection. However, when applied in practical applications, general CSI-based recognition models may face challenges related to the limited generalization capability, since individuals with different behavior habits will cause various fluctuations in the CSI data and it is difficult to gather enough training data to cover all kinds of motion habits. To tackle this problem, we design a diffusion model-based contrastive learning framework for human activity recognition (CLAR) using WiFi CSI. On the basis of the contrastive learning framework, we primarily introduce two components for CLAR to enhance the CSI-based activity recognition. To generate diverse augmented data and complement limited training data, we propose a diffusion model-based time series-specific augmentation model. In contrast to typical diffusion models that directly apply conditions to the generative process, potentially resulting in distorted CSI data, our tailored model dissects these condition into the high-frequency and low-frequency components, and then applies these conditions to the generative process with varying weights. This can alleviate the data distortion and yield high-quality augmented data. To efficiently capture the difference of the sample importance, we present an adaptive weight algorithm. Different from the typical contrastive learning methods which equally consider all the training samples, this algorithm adaptively adjusts the weights of positive sample pairs for learning better data representations. The experiments suggest that the CLAR achieves significant gains compared to the state-of-the-art methods.
引用
收藏
页码:33525 / 33536
页数:12
相关论文
共 71 条
[1]  
Caron M, 2020, ADV NEUR IN, V33
[2]   Device-Free Wireless Sensing With Few Labels Through Mutual Information Maximization [J].
Chen, Bo ;
Wang, Jie ;
Lv, Yingying ;
Gao, Qinghua ;
Pan, Miao ;
Fang, Yuguang .
IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (06) :10513-10524
[3]  
Chen N., 2021, P INT C LEARN REPR
[4]  
Chen T., 2020, INT C MACH LEARN PML, P1597
[5]   RF-Based Human Activity Recognition Using Signal Adapted Convolutional Neural Network [J].
Chen, Zhe ;
Cai, Chao ;
Zheng, Tianyue ;
Luo, Jun ;
Xiong, Jie ;
Wang, Xin .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (01) :487-499
[6]   WiFi CSI Based Passive Human Activity Recognition Using Attention Based BLSTM [J].
Chen, Zhenghua ;
Zhang, Le ;
Jiang, Chaoyang ;
Cao, Zhiguang ;
Cui, Wei .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2019, 18 (11) :2714-2724
[7]   COCOA: Cross Modality Contrastive Learning for Sensor Data [J].
Deldari, Shohreh ;
Xue, Hao ;
Saeed, Aaqib ;
Smith, Daniel V. ;
Salim, Flora D. .
PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2022, 6 (03)
[8]  
Ding S., 2021, P C EMB NETW SENS SY, P517
[9]   Channel State Reconstruction Using Multilevel Discrete Wavelet Transform for Improved Fingerprinting-Based Indoor Localization [J].
Fang, Shih-Hau ;
Chang, Wei-Hsiang ;
Tsao, Yu ;
Shih, Huang-Chia ;
Wang, Chiapin .
IEEE SENSORS JOURNAL, 2016, 16 (21) :7784-7791
[10]   Few-shot learning-based human activity recognition [J].
Feng, Siwei ;
Duarte, Marco F. .
EXPERT SYSTEMS WITH APPLICATIONS, 2019, 138