Personalized and motion-based human activity recognition with transfer learning and compressed deep learning models

被引:5
作者
Bursa, Sevda Ozge [1 ]
Incel, Ozlem Durmaz [2 ]
Alptekin, Gulfem Isiklar [1 ]
机构
[1] Galatasaray Univ, Dept Comp Engn, Ciragan Cad 36, TR-34349 Istanbul, Turkiye
[2] Bogazici Univ, Dept Comp Engn, TR-34342 Istanbul, Turkiye
关键词
Human activity recognition (HAR); Deep learning (DL); Transfer learning (TL); Model compression; Motion sensors;
D O I
10.1016/j.compeleceng.2023.108777
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Human activity recognition (HAR) enables the recognition of the activities of daily living using signals from motion sensors integrated into mobile and wearable devices. One of the challenges is the uniqueness of each individual with his/her different characteristics. A general model trained without user data may perform poorly on specific users. Another challenge is running deep learning (DL) models on mobile and wearable devices due to their limited resources. In this paper, to cope with these two challenges, we use transfer learning to build personalized models and model compression for running DL algorithms. We examine the impact of different DL architectures, the number of layers to be fine-tuned, the amount of user training data, and the transfer to new datasets on the performance of HAR. We compare the performance of the transferred models with general and user-specific models in terms of F1 score, training and inference time.
引用
收藏
页数:12
相关论文
共 29 条
  • [1] Anguita D., 2013, ESANN, V3, P3
  • [3] Attention-Based Deep Learning Framework for Human Activity Recognition With User Adaptation
    Buffelli, Davide
    Vandin, Fabio
    [J]. IEEE SENSORS JOURNAL, 2021, 21 (12) : 13474 - 13483
  • [4] Bursa Sevda Ozge, 2022, 2022 5th Conference on Cloud and Internet of Things (CIoT), P83, DOI 10.1109/CIoT53061.2022.9766512
  • [5] Hyperspectral imaging for skin assessment in systemic sclerosis: a pilot study
    Chen, Yi-Ming
    Lai, Kuo-Lung
    Chen, Hsin-Hua
    Huang, Wen-Nan
    Lin, Ching-Tsai
    Chao, Wen-Cheng
    Chen, Jun-Peng
    Fu, Yu-Wen
    Chen, Hsian-Min
    Lui, Ping-Wing
    [J]. RHEUMATOLOGY, 2020, 59 (11) : 3201 - 3210
  • [6] HuGaDB: Human Gait Database for Activity Recognition from Wearable Inertial Sensor Networks
    Chereshnev, Roman
    Kertesz-Farkas, Attila
    [J]. ANALYSIS OF IMAGES, SOCIAL NETWORKS AND TEXTS, AIST 2017, 2018, 10716 : 131 - 141
  • [7] Chikhaoui B., 2018, Machine Learning and Data Mining in Pattern Recognition, P302
  • [8] Hernandez N, 2020, SN COMPUT SCI, V1, P2661
  • [9] Hoelzemann A, 2020, IEEE INT SYM WRBL CO, P50, DOI 10.1145/3410531.3414311
  • [10] On-Device Deep Learning for Mobile and Wearable Sensing Applications: A Review
    Incel, Ozlem Durmaz
    Bursa, Sevda Ozge
    [J]. IEEE SENSORS JOURNAL, 2023, 23 (06) : 5501 - 5512