Hydra-TS: Enhancing Human Activity Recognition With Multiobjective Synthetic Time-Series Data Generation

被引:1
作者
Desmet, Chance [1 ]
Greeley, Colin [1 ]
Cook, Diane J. [1 ]
机构
[1] Washington State Univ, Sch Elect Engn & Comp Sci, Pullman, WA 99164 USA
基金
美国国家科学基金会; 美国国家卫生研究院;
关键词
Time series analysis; Sensors; Generative adversarial networks; Human activity recognition; Generators; Data models; Wearable Health Monitoring Systems; Data privacy; Synthetic data; Spectrogram; Generative adversarial network (GAN); human activity recognition (HAR); mobile computing; synthetic data generation; time-series analysis; NETWORK;
D O I
10.1109/JSEN.2024.3483108
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The advent of wearable technologies ushered in an era of abundant time-series data, offering profound insights into human health and behavior. However, the full utilization of such data was hindered by challenges such as the scarcity of labeled datasets and the need for privacy in sensitive domains like personal health tracking. To address these challenges, this article introduces Hydra-TS, a multiagent generative adversarial network (GAN). Hydra-TS uniquely excels in optimizing multiple objectives concurrently. Hydra-TS offers a spectral representation for time-series data. Here, a single generator is pitted against a variable number of discriminators to create multivariate synthetic data that are realistic, useful for classification, and privacy-preserving. Using a one-month dataset of real-world, in-the-wild smartwatch data containing 5271143 labeled activity instances for ten participants, we demonstrated that Hydra-TS yielded a superior area under the radar chart value (AuRC =0.72) in comparison with the original data and three baselines methods. We also verified that activity recognition performance was improved using Hydra-TS as a vehicle for data augmentation, improving the $F1$ score by as much as 130.54%. Hydra-TS's effectiveness underlines its potential to facilitate research and applications in areas where data scarcity and privacy issues are prevalent.
引用
收藏
页码:763 / 772
页数:10
相关论文
共 52 条
[1]   Attend and Discriminate: Beyond the State-of-the-Art for Human Activity Recognition UsingWearable Sensors [J].
Abedin, Alireza ;
Ehsanpour, Mahsa ;
Shi, Qinfeng ;
Rezatofighi, Hamid ;
Ranasinghe, Damith C. .
PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2021, 5 (01)
[2]  
Aminikhanghahi S, 2019, IEEE T KNOWL DATA EN, V31, P1010, DOI [10.1109/TKDE.2018.2850347, 10.1109/tkde.2018.2850347]
[3]   Semantic Loss: A New Neuro-Symbolic Approach for Context-Aware Human Activity Recognition [J].
Arrotta, Luca ;
Civitarese, Gabriele ;
Bettini, Claudio .
PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2023, 7 (04)
[4]   CHARM-Deep: Continuous Human Activity Recognition Model Based on Deep Neural Network Using IMU Sensors of Smartwatch [J].
Ashry, Sara ;
Ogawa, Tetsuji ;
Gomaa, Walid .
IEEE SENSORS JOURNAL, 2020, 20 (15) :8757-8770
[5]  
Biscione V, 2021, J MACH LEARN RES, V22
[6]   A novel data augmentation method to enhance deep neural networks for detection of atrial fibrillation [J].
Cao, Ping ;
Li, Xinyi ;
Mao, Kedong ;
Lu, Fei ;
Ning, Gangmin ;
Fang, Luping ;
Pan, Qing .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2020, 56
[7]   SMOTE: Synthetic minority over-sampling technique [J].
Chawla, Nitesh V. ;
Bowyer, Kevin W. ;
Hall, Lawrence O. ;
Kegelmeyer, W. Philip .
2002, American Association for Artificial Intelligence (16)
[8]   HMGAN: A Hierarchical Multi-Modal Generative Adversarial Network Model for Wearable Human Activity Recognition [J].
Chen, Ling ;
Hu, Rong ;
Wu, Menghan ;
Zhou, Xin .
PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2023, 7 (03)
[9]   Predicting individuals' privacy protection and self-tracking behaviors in the context of smart health [J].
Choi, Jaewon Royce ;
Kim, Seongcheol .
TELEMATICS AND INFORMATICS, 2024, 86
[10]  
Choi Jinyoung, 2022, Advances in Neural Information Processing Systems