Overcoming Data Scarcity in Human Activity Recognition

被引:2
作者
Konak, Orhan [1 ]
Liebe, Lucas [1 ]
Postnov, Kirill [1 ]
Sauerwald, Franz [1 ]
Gjoreski, Hristijan [2 ]
Lustrek, Mitja [3 ]
Arnrich, Bert [1 ]
机构
[1] Univ Potsdam, Hasso Plattner Inst, Potsdam, Germany
[2] Ss Cyril & Methodius Univ Skopje, Skopje, North Macedonia
[3] Jozef Stefan Inst, Dept Intelligent Syst, Ljubljana, Slovenia
来源
2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC | 2023年
关键词
D O I
10.1109/EMBC40787.2023.10340387
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Wearable sensors have become increasingly popular in recent years, with technological advances leading to cheaper, more widely available, and smaller devices. As a result, there has been a growing interest in applying machine learning techniques for Human Activity Recognition (HAR) in healthcare. These techniques can improve patient care and treatment by accurately detecting and analyzing various activities and behaviors. However, current approaches often require large amounts of labeled data, which can be difficult and time-consuming to obtain. In this study, we propose a new approach that uses synthetic sensor data generated by 3D engines and Generative Adversarial Networks to overcome this obstacle. We evaluate the synthetic data using several methods and compare them to real-world data, including classification results with baseline models. Our results show that synthetic data can improve the performance of deep neural networks, achieving a better F-1-score for less complex activities on a known dataset by 8.4% to 73% than state-of-the-art results. However, as we showed in a self-recorded nursing activity dataset of longer duration, this effect diminishes with more complex activities. This research highlights the potential of synthetic sensor data generated from multiple sources to overcome data scarcity in HAR.
引用
收藏
页数:7
相关论文
共 16 条
[1]   Synthetic Sensor Data for Human Activity Recognition [J].
Alharbi, Fayez ;
Ouarbya, Lahcen ;
Ward, Jamie A. .
2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
[2]  
[Anonymous], 2017, Real-valued (medical) time series generation with recurrent conditional gans
[3]   Deep learning for time series classification: a review [J].
Fawaz, Hassan Ismail ;
Forestier, Germain ;
Weber, Jonathan ;
Idoumghar, Lhassane ;
Muller, Pierre-Alain .
DATA MINING AND KNOWLEDGE DISCOVERY, 2019, 33 (04) :917-963
[4]  
Hoelzemann A, 2021, 2021 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS WORKSHOPS AND OTHER AFFILIATED EVENTS (PERCOM WORKSHOPS), P8, DOI [10.1109/PerComWorkshops51409.2021.9431046, 10.1109/PERCOMWORKSHOPS51409.2021.9431046]
[5]  
Hou CL, 2020, 2020 5TH INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATION SYSTEMS (ICCCS 2020), P225, DOI 10.1109/ICCCS49078.2020.9118506
[6]   Towards Machine Learning with Zero Real-World Data [J].
Kang, Cholmin ;
Jung, Hyunwoo ;
Lee, Youngki .
WEARSYS'19: PROCEEDINGS OF THE 5TH ACM WORKSHOP ON WEARABLE SYSTEMS AND APPLICATIONS, 2019, :41-46
[7]  
Konak O., 2022, NURSES EDGE DEVICE H
[8]  
Li P., 2022, ARXIV220502625
[9]   ActivityGAN: Generative Adversarial Networks for Data Augmentation in Sensor-Based Human Activity Recognition [J].
Li, Xi'ang ;
Luo, Jinqi ;
Younes, Rabih .
UBICOMP/ISWC '20 ADJUNCT: PROCEEDINGS OF THE 2020 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2020 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2020, :249-254
[10]   Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: State of the art and research challenges [J].
Nweke, Henry Friday ;
Teh, Ying Wah ;
Al-Garadi, Mohammed Ali ;
Alo, Uzoma Rita .
EXPERT SYSTEMS WITH APPLICATIONS, 2018, 105 :233-261